MPI-INF Logo
MPI-INF/SWS Research Reports 1991-2021

2. Number - only D5

MPI-I-2014-5-002

Phrase Query Optimization on Inverted Indexes

Anand, Avishek and Mele, Ida and Bedathur, Srikanta and Berberich, Klaus

October 2014, 20 pages.

.
Status: available - back from printing

Phrase queries are a key functionality of modern search engines. Beyond that, they increasingly serve as an important building block for applications such as entity-oriented search, text analytics, and plagiarism detection. Processing phrase queries is costly, though, since positional information has to be kept in the index and all words, including stopwords, need to be considered. We consider an augmented inverted index that indexes selected variable-length multi-word sequences in addition to single words. We study how arbitrary phrase queries can be processed efficiently on such an augmented inverted index. We show that the underlying optimization problem is NP-hard in the general case and describe an exact exponential algorithm and an approximation algorithm to its solution. Experiments on ClueWeb09 and The New York Times with different real-world query workloads examine the practical performance of our methods.

URL to this document: https://domino.mpi-inf.mpg.de/internet/reports.nsf/NumberView/2014-5-002

Hide details for BibTeXBibTeX
@TECHREPORT{AnandMeleBedathurBerberich2014,
  AUTHOR = {Anand, Avishek and Mele, Ida and Bedathur, Srikanta and Berberich, Klaus},
  TITLE = {Phrase Query Optimization on Inverted Indexes},
  TYPE = {Research Report},
  INSTITUTION = {Max-Planck-Institut f{\"u}r Informatik},
  ADDRESS = {Stuhlsatzenhausweg 85, 66123 Saarbr{\"u}cken, Germany},
  NUMBER = {MPI-I-2014-5-002},
  MONTH = {October},
  YEAR = {2014},
  ISSN = {0946-011X},
}