Exploiting statistics on query expressions for optimization

Abstract

Statistics play an important role in influencing the plans produced by a query optimizer. Traditionally, optimizers use statistics built over base tables and assume independence between attributes while propagating statistical information through the query plan. This approach can introduce large estimation errors, which may result in the optimizer choosing inefficient execution plans. In this paper, we show how to extend a generic optimizer so that it also exploits statistics built on expressions corresponding to intermediate nodes of query plans. We show that in some cases, the quality of the resulting plans is significantly better than when only base-table statistics are available. Unfortunately, even moderately-sized schemas may have too many relevant candidate statistics. We introduce a workload-driven technique to identify a small subset of statistics that can provide significant benefits over just maintaining base-table statistics. Finally, we present experimental results on an implementation of our approach in Microsoft SQL Server 2000.

Cite this paper

@article{bruno2002exploiting,
  title = {{Exploiting statistics on query expressions for optimization}},
  author = {Bruno, Nicolas and Chaudhuri, Surajit},
  journal = {ACM SIGMOD International Conference on Management of Data (SIGMOD)},
  pages = {263--274},
  year = {2002},
  doi = {10.1145/564691.564722}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.

Related papers