Use Case of RDMA in Symantec Storage Software Stack
Explore the implementation details and performance comparison of RDMA in Symantec's storage software stack, showcasing the benefits for faster interconnects and write operations. Learn about Symantec's proprietary approach and the impact on user applications and hardware configurations.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Use case of RDMA in Symantec storage software stack Om Prakash Agarwal Symantec
Agenda About Symantec Storage Software Stack Need for the faster interconnects Write operation without and with RDMA Implementation details: Write operation with RDMA Perf comparison (without and with RDMA) Symantec Proprietary: Use case of RDMA in Symantec storage stack 2
About Symantec Storage Software Stack User Applications Applications CVM/CFS CVM/CFS Kernel LLT LLT HBA NIC NIC HBA Hardware Shared storage Symantec Proprietary: Use case of RDMA in Symantec storage stack 3
Need for the faster interconnects User Applications Applications CVM/CFS CVM/CFS Kernel LLT LLT NIC NIC Hardware Local storage Local storage Shared Nothing Architecture Symantec Proprietary: Use case of RDMA in Symantec storage stack 4
Write operation without and with RDMA CVM/CFS Buffer CVM/CFS Bufptr Kernel Buffer Bufptr LLT LLT RDMA over InfiniBand or Ethernet Hardware RNIC RNIC NIC NIC Symantec Proprietary: Use case of RDMA in Symantec storage stack 5
Write operation with RDMA receiver sender CVM/CFS 4k 4k 8k 1k 1k 4k 4k 4k 4k 2k Message Message TX map TX map TX map TX map RX map RX map Actual Allocation Actual Allocation Actual allocation RX map RX map Destination buffer info Destination buffer info Destination buffer info Destination buffer info Actual allocation Buffer advertisement: Allocate buffers and send Meta data to sender node. 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k LLT 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 4k 6 Symantec Proprietary: Use case of RDMA in Symantec storage stack
Perf comparison (without and with RDMA) 1) Throughput 2) Latency Setup configuration Two node Linux (RHEL6.3) cluster ConnectX3 VPI NIC card from Mellanox IB -56 Gbps RoCE-40 Gbps Eth-40 Gbps 3.3GHz Processor Symantec Proprietary: Use case of RDMA in Symantec storage stack 7
LLT perf comparison : Throughput Higher is better 193% 125% Symantec Proprietary: Use case of RDMA in Symantec storage stack 8
LLT perf comparison : Latency 62% Lower is better Symantec Proprietary: Use case of RDMA in Symantec storage stack 9
Thank You #OFADevWorkshop
