基于确定性并发控制的云原生多写技术
作者:
作者单位:

作者简介:

通讯作者:

卢卫, E-mail: lu-wei@ruc.edu.cn

中图分类号:

基金项目:

国家自然科学基金(61972403,61732014);


Deterministic Concurrency Control based Multi-Write Transaction Processing over Cloud-native Databases
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    云原生数据库具有开箱即用、弹性伸缩、按需付费等优势, 是目前学术界和工业界的研究热点. 当前,云原生数据库仅支持"一写多读", 即读写事务集中在单一的读写节点, 只读事务分散到多个只读节点. 将读写事务集中在单一的读写节点, 制约了系统的读写事务处理能力, 难以满足读写密集型业务需求. 为此, 本文提出了D3C(deterministic concurrency control cloud database)架构, 通过设计基于确定性并发控制的云原生数据库事务处理机制来突破一写多读的限制, 支持多个读写节点并发执行读写事务. 其中D3C将事务分拆为子事务, 并根据预先确定的全局顺序在各节点独立执行这些子事务, 以满足多个读写节点上事务执行的可串行化. 此外本文提出了基于多版本机制的异步批量数据持久化等机制保证事务处理的性能, 并提出基于一致性点的故障恢复机制实现高可用. 实验表明, D3C在满足云原生数据库关键需求的同时, 在写密集场景下能达到一写多读性能的5.1倍.

    Abstract:

    Cloud-native databases have emerged as a hot topic in the field of database development in the era of cloud computing, thanks to their advantages such as out-of-the-box functionality, elastic scalability, and pay-as-you-go pricing. However, mainstream cloud-native databases only support a single master node to execute write transactions. This limitation hampers the system's ability to handle write-intensive workloads, making it difficult to meet the demands of businesses with high write requirements. To address this issue, this paper proposes the D3C (deterministic concurrency control cloud database) architecture, which achieves cloud-native multi-writer capabilities by designing a transaction processing mechanism based on deterministic concurrency control. D3C splits transactions into sub-transactions and independently executes them on various nodes according to a pre-defined global order, ensuring serializable isolation for transaction execution on multiple read-write nodes. Additionally, this paper introduces mechanisms such as asynchronous batch data persistence mechanisms based on multi-version to ensure the performance of multi-writer transaction processing, and proposes a consistency point-based fault recovery mechanism to achieve high availability. Experiments have shown that D3C can achieve 5.1 times the throughput of a traditional single-master architecture in write-intensive scenarios, while meeting the key requirements of cloud-native databases.

    参考文献
    相似文献
    引证文献
引用本文

洪殷昊,赵泓尧,王乙霖,史心悦,卢卫,杨尚,杜胜.基于确定性并发控制的云原生多写技术.软件学报,2025,36(3):1-29

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-05-27
  • 最后修改日期:2024-08-19
  • 录用日期:
  • 在线发布日期: 2024-09-13
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号