Campus Event Calendar
Event Entry
What and Who
The Holumbus Framework: Distributed computing with MapReduce in Haskell
Stefan Schmidt
University of Applied Sciences Wedel
PhD Application Talk
AG 1, AG 3, AG 4, AG 5, SWS, RG1, MMCI
Public Audience
English
Note: We use this to send email in the morning.
Date, Time and Location
Monday, 19 October 2009
09:00
240 Minutes
E1 4
024
Saarbrücken
Abstract
Although current computers are very fast, the processing of hundreds of gigabytes of data still may take several hours or even days on a single processor system. When using multiple computers in parallel for the computation, the costs for design and implementation of a distributed system are very high. The MapReduce concept - developed at Google Inc. - encapsulates the efforts of parallelism in a single library. It provides a simple but powerful framework to build distributed applications without having deeper knowledge of parallel programming.
I've implemented a MapReduce framework in Haskell, a purely functional programming language. The whole system consists of three parts: a communication system for interprocess message passing, a distributed storage system and the MapReduce library itself. In my talk I give an overview of the Holumbus MapReduce framework and its three subsystems. I also present the current project status and the latest improvements.
Contact
--email hidden
passcode not visible
logged in users only
Jennifer Gerling, 10/07/2009 17:07
Heike Przybyl, 10/07/2009 16:22 -- Created document.
Heike Przybyl, 10/07/2009 16:22 -- Created document.