MPI-INF Logo
Campus Event Calendar

Event Entry

What and Who

Sample compression schemes for VC classes

Shay Moran
Max-Planck-Institut für Informatik - D1
AG1 Mittagsseminar (own work)
AG 1, AG 2, AG 3, AG 4, AG 5, RG1, SWS, MMCI  
MPI Audience
English

Date, Time and Location

Thursday, 9 July 2015
13:00
45 Minutes
E1 4
024
Saarbrücken

Abstract

Sample compression schemes were defined by Littlestone and Warmuth (1986)

as an abstraction of the structure underlying many learning algorithms.
Roughly speaking, a sample compression scheme of size $k$ means that given an arbitrary list of labeled examples, one can retain only $k$ of them in a way that allows to recover the labels of all other examples in the list. They showed that compression implies PAC learnability for binary-labeled classes, and asked whether the other direction holds.
We answer their question and show that every concept class $C$ with VC dimension $d$ has a sample compression scheme of size exponential in $d$.
The proof uses an approximate minimax phenomenon for binary matrices of low VC dimension, which may be of interest in the context of game theory.

Joint work with Amir Yehudayoff

The talk will assume no previous knowledge in machine learning.
The talk will take 45 minutes.


Link to paper: http://eccc.hpi-web.de/report/2015/040/

Contact

Shay Moran
--email hidden
passcode not visible
logged in users only

Shay Moran, 07/07/2015 14:54
Shay Moran, 06/13/2015 12:27
Shay Moran, 06/02/2015 22:00
Shay Moran, 06/02/2015 21:58 -- Created document.