A SNIA event
September 16-18, 2024

Implementation of Persistent Write Log Cache with Replication in Ceph

Abstract

Ceph is an open source distributed storage solution. This presentation shows the implementation of Persistent Write Log Cache(PWL cache) at Ceph client side to handle burst writes to reduce backend pressure. PWL cache is a kind of Write Back Cache, but it leverages log to ensure the I/O order. Compared with the traditional volatile cache, PWL cache persists the data to Persistent memory (PMEM). In order to prevent data loss caused by abnormal conditions, we implement Replication for PWL. Through RDMA technology, we can replicate data to the remote side unilaterally with minimum overhead.

Download Presentation
Related Sessions
Cloud Storage
More Than Just a Bucket of Bits: Cloud Object Storage turns Sweet Sixteen

With Amazon S3 celebrating its sixteenth birthday this year, it's easy to forget just how revolutionary it was at its release.

Pat Patterson
Backblaze
Favorites
Cloud Storage
Direct Drive - Azure's Next-generation Block Storage Architecture

Azure Disks provide block storage for Azure Virtual Machines and are a core pillar of the Azure IaaS platform.

Greg Kramer
Microsoft
Favorites
Cloud Storage
Behind the Scenes for Azure Block Storage Unique Capabilities

Azure Block Storage, also referred to as Azure Disks, is the persistent block storage for Azure Virtual Machines and a core pillar for Azure IaaS infrastructure.

Yuemin Lu
Microsoft
Favorites
Cloud Storage
Lessons Learned (the hard way) from Building a Global, Decentralized Storage Network

Durability and performance in an S3 alternative storage platform are complex problems, but not owning the hard drives brings another level of difficulty.

Favorites
Cloud Storage
Demystifying Edge Devices Cloud Native Storage Services for Different Data Sources

Edge is becoming the new core .More and more data will live in edge environments rather than in traditional data centers/cloud due to reasons ranging from data gravity to data sovereignty.Different

Umang Kumar
Hewlett packard enterprise
Favorites
Cloud Storage
Cloud Storage Acceleration Layer (CSAL): Enabling Unprecedented Performance and Capacity Values with Optane and QLC Flash

Cloud service providers offer a range of storage services to enterprises, such as block storage and object storage. Currently, more data is being created, stored, and analyzed than ever before.

Qinghua Ye
Alibaba Cloud
Favorites
Cloud Storage
What’s faster than a Cheetah and more flexible than a Cirque du Soleil performer? The new SPDK Accelerator Framework!

Many years ago SPDK introduced the “Copy Framework”, a light weight framework for supporting one HW accelerator, Intel® IOAT, behind a generic API so that acceleration would be used if available an

Paul Luse
Intel
Favorites
Cloud Storage
Building an Object based STaaS solution with Poseidon Storage

Samsung recently contributed Poseidon project, which is an OCP-based industry collaboration between component vendor (Samsung), system vendor(Inspur) and data center.

Favorites
Cloud Storage
Designing multi storage infrastructure in cloud deployment

The major Cloud Providers such as VMWare, Microsoft and Google provide workload suites to deploy and manage container microservices and cloud storage through data models.

Parmeshwr Prasad
Dell, Co-Chair for SNIA Blockchain TWG
Favorites