MPI-INF/SWS Research Reports 1991-2021

2. Number - only D5


Automated retraining methods for document classification and their parameter tuning

Siersdorfer, Stefan and Weikum, Gerhard

September 2005, 23 pages.

Status: available - back from printing

This paper addresses the problem of semi-supervised classification on document collections using retraining (also called self-training). A possible application is focused Web crawling which may start with very few, manually selected, training documents but can be enhanced by automatically adding initially unlabeled, positively classified Web pages for retraining. Such an approach is by itself not robust and faces tuning problems regarding parameters like the number of selected documents, the number of retraining iterations, and the ratio of positive and negative classified samples used for retraining. The paper develops methods for automatically tuning these parameters, based on predicting the leave-one-out error for a re-trained classifier and avoiding that the classifier is diluted by selecting too many or weak documents for retraining. Our experiments with three different datasets confirm the practical viability of the approach.

  • Attachement: (262 KBytes)

URL to this document:

Hide details for BibTeXBibTeX
  AUTHOR = {Siersdorfer, Stefan and Weikum, Gerhard},
  TITLE = {Automated retraining methods for document classification and their parameter tuning},
  TYPE = {Research Report},
  INSTITUTION = {Max-Planck-Institut f{\"u}r Informatik},
  ADDRESS = {Stuhlsatzenhausweg 85, 66123 Saarbr{\"u}cken, Germany},
  NUMBER = {MPI-I-2005-5-002},
  MONTH = {September},
  YEAR = {2005},
  ISSN = {0946-011X},