基于树型门控循环单元的基数和代价估计器
作者:
作者单位:

作者简介:

乔少杰(1981-),男,博士,教授,CCF杰出会员,主要研究领域为数据库,人工智能,数据挖掘;
陈浩(1989-),男,学士,主要研究领域为数据库的优化器与执行器;
杨国平(1997-),男,硕士生,CCF学生会员,主要研究领域为数据库查询优化;
毛睿(1975-),男,博士,教授,博士生导师,CCF杰出会员,主要研究领域为大数据;
韩楠(1984-),女,博士,副教授,主要研究领域为数据库,数据挖掘.元昌安(1964-),男,博士,教授,博士生导师,CCF专业会员,主要研究领域为数据库;
屈露露(1998-),女,硕士生,CCF学生会员,主要研究领域为人工智能,数据挖掘;
Louis Alberto GUTIERREZ(1980-),男,博士,Researcher,主要研究领域为人工智能.

通讯作者:

韩楠,E-mail:hannan@cuit.edu.cn

中图分类号:

基金项目:

国家自然科学基金(61772091,61802035,61962006,61962038,U1802271,U2001212,62072311);CCF-华为数据库创新研究计划(CCF-HuaweiDBIR2020004A);四川省科技计划(2021JDJQ0021,2020YJ0481,2020YJ0430);成都市重大科技创新项目(2021-YF08-00156-GX);成都市技术创新研发项目(2021-YF05-00491-SN);四川音乐学院数字媒体艺术四川省重点实验室资助项目(21DMAKL02);广西自然科学基金(2018GXNSFDA138005);广东省基础与应用基础研究基金(2020B1515120028)


Cardinality and Cost Estimator Based on Tree Gated Recurrent Unit
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    基数估计和代价估计可以引导执行计划的选择,估计准确性对查询优化器至关重要.然而,传统数据库的代价和基数估计技术无法提供准确的估计,因为现有技术没有考虑多个表之间的相关性.将人工智能技术应用于数据库(artificial intelligence for databases,AI4DB)近期得到广泛关注,研究结果表明,基于学习的估计方法优于传统方法.然而,现有基于学习的方法仍然存在不足:首先,大部分的方法只能估计基数,但忽略了代价估计;其次,这些方法只能处理一些简单的查询语句,对于多表查询、嵌套查询等复杂查询则无能为力;同时,对字符串类型的值也很难处理.为了解决上述问题,提出了一种基于树型门控循环单元,Tree-GRU (tree-gated recurrent unit)的基数和代价估计方法,可以同时对基数和代价进行估计.此外,采用了有效的特征提取和编码技术,在特征提取中兼顾查询和执行计划,将特征嵌入到Tree-GRU中.对于字符串类型的值,使用神经网络自动提取子串与整串的关系,并进行字符串嵌入,从而使具有稀疏性的字符串变得容易被估计器处理.在JOB、Synthetic等数据集上进行了大量实验,实验结果表明,所提模型的各方面性能优于主流算法.

    Abstract:

    Cardinality estimation and cost estimation can guide the selection of execution plan, and cardinality accuracy is very important for query optimizer. However, the cost and cardinality estimation techniques in traditional databases cannot provide accurate estimations because they do not consider the correlation across multiple tables. Recently, the application of artificial intelligence technology to databases (artificial intelligence for databases, AI4DB) has attracted wide attention, and the results show that the learning-based estimation method is superior to the traditional methods. However, the existing learning-based methods have some drawbacks. Firstly, most methods can only estimate the cardinality, but ignore the cost estimation. Secondly, these methods can only deal with some simple query statements, while do not work for complex queries, such as multi-table query and nested query. At the same time, it is also difficult for them to deal with string type of values. In order to solve the above problems, a novel method of estimating the cardinality and cost based on Tree-GRU (tree-gated recurrent unit), which can estimate the cardinality as well as the cost. In addition, an effective feature extraction and coding technology is applied, both query and execution plan are considered in feature extraction. These features are embedded into Tree-GRU. For the value of string type, the neural network is used to automatically extract the relationship between the substring and the whole string, embedding the string, so that the sparse string can be easily processed by the estimator. Extensive experiments were conducted on the JOB and Synthetic datasets and the results show that the performance of the proposed model outperforms the state-of-the-art algorithms in all aspects.

    参考文献
    相似文献
    引证文献
引用本文

乔少杰,杨国平,韩楠,屈露露,陈浩,毛睿,元昌安,Louis Alberto GUTIERREZ.基于树型门控循环单元的基数和代价估计器.软件学报,2022,33(3):797-813

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2021-06-30
  • 最后修改日期:2021-07-31
  • 录用日期:
  • 在线发布日期: 2021-10-21
  • 出版日期: 2022-03-06
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号