Campus Event Calendar
Event Entry
What and Who
Learning in Query Optimization
Volker Markl
IBM Almaden Research Center
Talk
AG 1, AG 2, AG 3, AG 4, AG 5, SWS
Expert Audience
English
Note: We use this to send email in the morning.
Date, Time and Location
Tuesday, 10 October 2006
13:00
-- Not specified --
E1 4
024
Saarbrücken
Abstract
Database Systems let users specify queries in a declarative language
like SQL. Most modern DBMS optimizers rely upon a cost model to choose
the best query execution plan (QEP) for any given query. Cost estimates
are heavily dependent upon the optimizer's estimates for the number
of rows that will result at each step of the QEP for complex
queries involving many predicates and/or operations. These estimates,
in turn, rely upon statistics on the database and modeling assumptions
that may or may not be true for a given database. In the first part
of our talk, we present research on learning in query optimization
that we have carried out at the IBM Almaden Research Center. We
introduce LEO, DB2's LEarning Optimizer, as a comprehensive way to
repair incorrect statistics and cardinality estimates of a query
execution plan. By monitoring executed queries, LEO compares the
optimizer's estimates with actuals at each step in a QEP, and computes
adjustments to cost estimates and statistics that may be used during the
current and future query optimizations. LEO introduces a feedback loop
to query optimization that enhances the available information on the
database where the most queries have occurred, allowing the optimizer
to actually learn from its past mistakes.
In the second part of the talk, we describe how the knowledge gleaned by
LEO is exploited consistently in a query optimizer, by adjusting the
optimizer's model and by maximzing information entropy.
like SQL. Most modern DBMS optimizers rely upon a cost model to choose
the best query execution plan (QEP) for any given query. Cost estimates
are heavily dependent upon the optimizer's estimates for the number
of rows that will result at each step of the QEP for complex
queries involving many predicates and/or operations. These estimates,
in turn, rely upon statistics on the database and modeling assumptions
that may or may not be true for a given database. In the first part
of our talk, we present research on learning in query optimization
that we have carried out at the IBM Almaden Research Center. We
introduce LEO, DB2's LEarning Optimizer, as a comprehensive way to
repair incorrect statistics and cardinality estimates of a query
execution plan. By monitoring executed queries, LEO compares the
optimizer's estimates with actuals at each step in a QEP, and computes
adjustments to cost estimates and statistics that may be used during the
current and future query optimizations. LEO introduces a feedback loop
to query optimization that enhances the available information on the
database where the most queries have occurred, allowing the optimizer
to actually learn from its past mistakes.
In the second part of the talk, we describe how the knowledge gleaned by
LEO is exploited consistently in a query optimizer, by adjusting the
optimizer's model and by maximzing information entropy.
Contact
Gerhard Weikum
500
--email hidden
passcode not visible
logged in users only
Petra Schaaf, 10/09/2006 10:16
Petra Schaaf, 08/28/2006 12:58 -- Created document.
Petra Schaaf, 08/28/2006 12:58 -- Created document.