Flexible Scheme of Space Management in ZNS SSD/SMR HDD Storage Pool
The flexible scheme of space management in ZNS SSD/SMR HDD storage pool for multiple virtual machines addresses the architecture vision, storage pool concept, management problems, and page table like architecture. Hosts, VMs, storage devices, core components, LBAs, and aggregated LBA space within the storage pool are detailed, along with on-demand allocation and easy migration schemes. The concept also covers reliability, erasure coding, and replication schemes.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Flexible scheme of space management in ZNS SSD / SMR HDD storage pool for multiple virtual machines Viacheslav Dubeyko SSDFS.ORG 1
Content 1. 2. 3. 4. 5. Storage pool concept Architecture vision Storage pool space management problem Page table like architecture Open questions SSDFS.ORG 2
Storage pool concept Host #1 VM #1 Storage device #1 Storage device #k VM #2 Core #1 Core #k Storage device #l Storage device #n Core #l Core #n VM #n Host #n Storage pool VM pool SSDFS.ORG 3
Architecture vision Host #1 LBA #1 VM #1 Storage device #1 Storage device #k LBA #2 VM #2 LBA #3 Core #1 Core #k Storage device #l Storage device #n Core #l Core #n VM #n LBA #n Host #n Aggregated LBA space Storage pool VM pool SSDFS.ORG 4
Storage pool space management problem VM FS volume LBA #1 LBA #1 LBA #1 LBA #2 LBA #2 LBA #2 LBA #n LBA #n LBA #n Storage device #1 Storage device #n Storage pool SSDFS.ORG 5
Page-table like architecture Block table #1 LBA #1 LBA #n ublk #1 VM #1 ublk #2 VM #2 Storage device #1 Block table #2 Storage device #2 Block table #n VM #n ublk #n Storage device #n SSDFS.ORG 6
Flexible resize scheme resize VM Block table Storage device #n Storage device #1 Storage device #2 Storage pool SSDFS.ORG 7
On-demand allocation scheme VM Block table Storage device #n Storage device #1 Storage device #2 Storage pool SSDFS.ORG 8
Easy migration scheme VM (1) Move (2) Update block table Block table COW policy ZNS SSD SMR HDD GC 2 LBA #1 LBA #1 LBA #1 LBA #n LBA #n LBA #n 1 Storage device #1 Storage device #2 Storage device #n SSDFS.ORG 9
Reliability scheme VM Block table Erasure coding scheme Replication scheme LBA #1 LBA #1 LBA #1 LBA #n LBA #n LBA #n Storage device #1 Storage device #2 Storage device #n SSDFS.ORG 10
Computation offloading VM Block table Compression, Delta-encoding, Deduplication, Erasure coding, Scrubbing DRAM DRAM core core Storage device #n Storage device #1 SSDFS.ORG 11
Aggregated LBA space management Storage device #1 dd Block table #1 ublk #1 VM #1 LBA #1 Zone allocator dd Storage device #2 Host #1 dd LBA #2 Block table #2 ublk #2 VM #2 Storage device #3 LBA #3 dd kernel-space user-space Zone sharing Storage device #4 Fabric user-space dd Zone sharing Storage device #n Zone allocator dd Storage device #n+1 dd Block table #n ublk #n VM #n Host #n Storage device #n+2 LBA #n dd Block table #n+1 ublk #n+1 VM #n+1 kernel-space Storage device #n+3 Aggregated LBA space SSDFS.ORG 12
Open questions How to distribute the aggregated LBA space among virtual machines without the knowledge about each other? How to store block table for every VM? Should it be one block table for all VMs? Where does it make sense to keep the block table (in user-space or kernel-space)? Does it make sense to keep the aggregated LBA space allocator in kernel-space and block table for each VM in user-space? SSDFS.ORG 13
THANK YOU QUESTIONS??? slava@dubeyko.com SSDFS.ORG 14
