MPI-INF Logo
Campus Event Calendar

Event Entry

What and Who

Location-aware web crawling with the use of Migrating Crawlers, part II

Odysseas Papapetrou
IMPRS
Masters' Lunch
AG 1, AG 2, AG 3, AG 4, AG 5  
MPI Audience

Date, Time and Location

Tuesday, 17 May 2005
12:59
-- Not specified --
46.1 - MPII
024
Saarbrücken

Abstract

Distributed crawling has shown that it can overcome important
limitations of the centralized crawling paradigm. However, the
distributed nature of current distributed crawlers is not fully
utilized. The optimal benefits of this approach are usually limited to
the sites hosting the crawler. We describe IPMicra, a distributed
location aware web crawler that utilizes an IP address hierarchy and
allows crawling of links in a near optimal location aware manner. The
crawler outperforms earlier distributed crawling approaches without a
significant overhead.

Contact

Kerstin Kathy Meyer-Ross
93 25 226
--email hidden
passcode not visible
logged in users only

Christine Kiesel, 05/09/2005 08:47
Christine Kiesel, 01/06/2005 10:38
Kerstin Meyer-Ross, 11/29/2004 08:11
Kerstin Meyer-Ross, 11/27/2004 10:51 -- Created document.