MPI-INF Logo
Campus Event Calendar

Event Entry

What and Who

The practice of acquiring good labels

Omar Alonso
University of California
Talk
AG 1, AG 2, AG 3, AG 4, AG 5, SWS, RG1, MMCI  
Public Audience
English

Date, Time and Location

Monday, 11 July 2016
11:00
60 Minutes
E1 4
0.24
Saarbrücken

Abstract

Engineers and researchers use human computation as a mechanism to produce labeled data sets for product development, research, and experimentation. In a data-driven world, good labels are key. To gather useful results, a successful labeling task relies on many different elements: from clear instructions and user interface design to algorithms for quality control. Furthermore, designing and implementing tasks that produce and use several thousands or millions of labels is different than conducting small scale research investigations. In this talk, I will present a perspective for collecting high quality labels with an emphasis on practical implementations and scalability. I will focus on three main topics: programming crowds, debugging tasks with low agreement, and algorithms for quality control.

Contact

Daniela Alessi
5000
--email hidden
passcode not visible
logged in users only

Daniela Alessi, 07/01/2016 13:33 -- Created document.