首页|Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design Guidelines

Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design Guidelines

扫码查看
Remote data structures built with one-sided Remote Direct Memory Access (RDMA) are at the heart of manydisaggregated database management systems today. Concurrent access to these data structures by thousandsof remote workers necessitates a highly efficient synchronization scheme. Remarkably, our investigation revealsthat existing synchronization schemes display substantial variations in performance and scalability.Even worse, some schemes do not correctly synchronize, resulting in rare and hard-to-detect data corruption.Motivated by these observations, we conduct the first comprehensive analysis of one-sided synchronizationtechniques and provide general principles for correct synchronization using one-sided RDMA. Our researchdemonstrates that adherence to these principles not only guarantees correctness but also results in substantialperformance enhancements. This article is an extended version of [72] in which we investigate modern400G NICs. Our findings reveal that the challenges persist even with new generations of NICs. Consequently,we turn our attention to alternative networking hardware, such as smart switches, to address some of thelimitations associated with one-sided synchronization.

Distributed database management systemsRDMAsynchronization

MATTHIAS JASNY、TOBIAS ZIEGLER、JACOB NELSON-SLIVON、VIKTOR LEIS、CARSTEN BINNIG

展开 >

Technische Universitaet Darmstadt, Darmstadt, Germany

Technische Universitaet Muenchen, Muenchen, Germany

Google, Boulder, United States

Technische Universitaet Darmstadt, Darmstadt, Germany and DFKI, Darmstadt, Germany

展开 >

2025

ACM Transactions on Database Systems

ACM Transactions on Database Systems

ISSN:0362-5915
年,卷(期):2025.50(1)
  • 73