Skip to content

Latest commit

 

History

History
56 lines (50 loc) · 3.12 KB

README.md

File metadata and controls

56 lines (50 loc) · 3.12 KB

Expanders

The objective of query refinement is to produce a set of potential candidate queries that can function as enhanced and improved versions. This involves systematically applying various unsupervised query refinement techniques to each query within the input dataset.

Class Diagram for Query Expanders in qe/. [zoom in!].

The expanders are initialized by the Expander Factory in qe/cmn/expander_factory.py

Here is the list of queries:

Expander Category Analyze type
adaponfields Top_Documents Local
anchor Anchor_Text Global
backtranslation Machine_Translation Global
bertqe Top_Documents Local
conceptluster Concept_Clustering Local
conceptnet Semantic_Analysis Global
docluster Document_Summaries Local
glove Semantic_Analysis Global
onfields Top_Documents Local
relevancefeedback Top_Documents Local
rm3 Top_Documents Local
sensedisambiguation Semantic_Analysis Global
stem.krovetz Stemming_Analysis Global
stem.lovins Stemming_Analysis Global
stem.paicehusk Stemming_Analysis Global
stem.porter Stemming_Analysis Global
stem.sstemmer Stemming_Analysis Global
stem.trunc Stemming_Analysis Global
tagmee Wikipedia Global
termluster Term_Clustering Local
thesaurus Semantic_Analysis Global
wiki Wikipedia Global
word2vec Semantic_Analysis Global
wordnet Semantic_Analysis Global

Adaponfields

Anchor

Backtranslation

Back translation, also known as reverse translation or dual translation, involves translating content, whether it is a query or paragraph, from one language to another and retranslating it to the original language. This method provides several options for the owner to make a decision that makes the most sense based on the task at hand. For additional details, please refer to this document.

Example

q map q language translated q backtranslated q map q'
Italian nobel prize winners 0.2282 farsi برندهای جایزه نوبل ایتالیایی Italian Nobel laureates 0.5665
banana paper making 0.1111 korean 바나나 종이 제조 Manufacture of banana paper 1
figs 0.0419 tamil அத்திமரங்கள் The fig trees 0.0709

Bertqe

Conceptluster