Proceedings Article, Paper
@InProceedings
Beitrag in Tagungsband, Workshop


Show entries of:

this year (2019) | last year (2018) | two years ago (2017) | Notes URL

Action:

login to update

Options:








Author, Editor

Author(s):

Neumann, Thomas
Bender, Matthias
Michel, Sebastian
Weikum, Gerhard

dblp
dblp
dblp
dblp



Editor(s):

Bonnet, Philippe
Manolescu, Ioana

dblp
dblp

Not MPII Editor(s):

Bonnet, Philippe
Manolescu, Ioana

BibTeX cite key*:

NeumannBMW06

Title, Booktitle

Title*:

A Reproducible Benchmark for P2P Retrieval

Booktitle*:

Proceedings of the 1st International Workshop on Performance and Evaluation of Data Management Systems, ExpDB 2006, in cooperation with ACM SIGMOD

Event, URLs

URL of the conference:

http://gemo.futurs.inria.fr/events/EXPDB2006/

URL for downloading the paper:

http://gemo.futurs.inria.fr/events/EXPDB2006/PAPERS/Neumann.pdf

Event Address*:

Chicago, Illinois, USA

Language:

English

Event Date*
(no longer used):


Organization:


Event Start Date:

30 June 2006

Event End Date:

30 June 2006

Publisher

Name*:

ACM

URL:


Address*:

New York, USA

Type:


Vol, No, Year, pp.

Series:


Volume:


Number:


Month:


Pages:

1-8

Year*:

2006

VG Wort Pages:

34

ISBN/ISSN:

1-59593-463-4

Sequence Number:


DOI:




Note, Abstract, ©


(LaTeX) Abstract:

With the growing popularity of information retrieval (IR)
in distributed systems and in particular {P2P} Web search, a
huge number of protocols and prototypes have been introduced
in the literature. However, nearly every paper considers
a different benchmark for its experimental evaluation,
rendering their mutual comparison and the quantification of
performance improvements an impossible task.
We present a standardized, general purpose benchmark
for {P2P IR} systems that finally makes this possible. We
start by presenting a detailed requirement analysis for such
a standardized benchmark framework that allows for reproducible
and comparable experimental setups without sacrificing
flexibility to suit different system models. We further
suggest Wikipedia as a publicly-available and all-purpose
document corpus and finally introduce a simple but yet flexible
clustering strategy that assigns the Wikipedia articles as
documents to an arbitrary number of peers. After proposing
a standardized, real-world query set as the benchmark
workload, we review the metrics to evaluate the benchmark
results and present an example benchmark run for our fullyimplemented
{P2P} Web search prototype {MINERVA}.



Download
Access Level:

Internal

Correlation

MPG Unit:

Max-Planck-Institut für Informatik



MPG Subunit:

Databases and Information Systems Group

Audience:

Expert

Appearance:

MPII WWW Server, MPII FTP Server, MPG publications list, university publications list, working group publication list, Fachbeirat, VG Wort



BibTeX Entry:

@INPROCEEDINGS{NeumannBMW06,
AUTHOR = {Neumann, Thomas and Bender, Matthias and Michel, Sebastian and Weikum, Gerhard},
EDITOR = {Bonnet, Philippe and Manolescu, Ioana},
TITLE = {A Reproducible Benchmark for {P2P} Retrieval},
BOOKTITLE = {Proceedings of the 1st International Workshop on Performance and Evaluation of Data Management Systems, ExpDB 2006, in cooperation with ACM SIGMOD},
PUBLISHER = {ACM},
YEAR = {2006},
PAGES = {1--8},
ADDRESS = {Chicago, Illinois, USA},
ISBN = {1-59593-463-4},
}


Entry last modified by Anja Becker, 05/04/2011
Show details for Edit History (please click the blue arrow to see the details)Edit History (please click the blue arrow to see the details)
Hide details for Edit History (please click the blue arrow to see the details)Edit History (please click the blue arrow to see the details)

Editor(s)
Adriana Davidescu
Created
07/27/2006 05:15:32 PM
Revisions
8.
7.
6.
5.
4.
Editor(s)
Anja Becker
Adriana Davidescu
Adriana Davidescu
Uwe Brahm
Uwe Brahm
Edit Dates
04.05.2011 10:57:32
20.07.2007 19:00:09
20.07.2007 15:36:53
2007-04-27 14:57:32
04.04.2007 14:12:11