MPI-INF/SWS Research Reports 1991-2021

2. Number - All Departments


Real-time text queries with tunable term pair indexes

Broschart, Andreas and Schenkel, Ralf

October 2010, 41 pages.

Status: available - back from printing

Term proximity scoring is an established means in information retrieval for improving result quality of full-text queries. Integrating such proximity scores into efficient query processing, however, has not been equally well studied. Existing methods make use of precomputed lists of documents where tuples of terms, usually pairs, occur together, usually incurring a huge index size compared to term-only indexes. This paper introduces a joint framework for trading off index size and result quality, and provides optimization techniques for tuning precomputed indexes towards either maximal result quality or maximal query processing performance, given an upper bound for the index size. The framework allows to selectively materialize lists for pairs based on a query log to further reduce index size. Extensive experiments with two large text collections demonstrate runtime improvements of several orders of magnitude over existing text-based processing techniques with reasonable index sizes.

URL to this document:

Hide details for BibTeXBibTeX
  AUTHOR = {Broschart, Andreas and Schenkel, Ralf},
  TITLE = {Real-time text queries with tunable term pair indexes},
  TYPE = {Research Report},
  INSTITUTION = {Max-Planck-Institut f{\"u}r Informatik},
  ADDRESS = {Stuhlsatzenhausweg 85, 66123 Saarbr{\"u}cken, Germany},
  NUMBER = {MPI-I-2010-5-006},
  MONTH = {October},
  YEAR = {2010},
  ISSN = {0946-011X},