VXFabric: PCI-Express Switch Fabric for High-Performance Embedded Computing
Discover VXFabric, a PCIe interconnect technology facilitating high-speed data transfer between multiple processor nodes. Learn about its hardware and software components, performance benchmarks under TCP/IP, and scalability features for efficient data processing in HPEC systems.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
VXFabric: PCI-Express Switch Fabric for HPEC Poster B.7, Technologies and Systems Robert Negre, Business Technology Director Kontron Modular Computers SAS France MIT Lincoln Laboratory VXFabric-1 Kontron 9/22/2011
VXFabric: PCI-Express Switch Fabric for HPEC VXFabric is a new PCIe interconnect between multiple processor nodes VXFabric is based on Internet Protocol over PCI-Express At the hardware level, it is built on PCIe Gen2/Gen3 links using non transparent PCIe bridges, allowing peer-to-peer DMAs. Implemented on Open VPX computers & PCIe switch boards At the software level, VXFabric provides a socket API giving access to TCP/IP or UDP/IP protocols, Low latency, Light weight protocol, Plug & play thanks to IP sockets 12 PCIe Links 12 PCIe centralized switch Six VX6060 = 12 processors = 24 cores MIT Lincoln Laboratory VXFabric-2 Kontron 9/22/2011
VXFabric Software API VXFabric user programming model is based on a socket Internet Protocol allowing direct use of TCP/IP or UDP/IP A low level protocol takes care of data transfers between processor nodes User Socket Application VXFabric CLI Kernel Network Layer Operating System Lightweight Protocol vxeth vxdma vxfabric Allocator Hardware PCIe links and PCIe switch vxfabric deals with the mappings, status and low level protocol of the fabric vxdma implements the DMA API used by other modules to read/write data over PCIe vxeth creates the Ethernet emulation of VXFabric MIT Lincoln Laboratory VXFabric-3 Kontron 9/22/2011
VXFabric Performances under TCP/IP VXFabric measured sustained performance, per PCIe x2 Gen2 link The VXFabric software lightweight protocol frees up more of the CPUs bandwidth for processing data Aggregate performance for a 12-node VXFabric exceeds 51 Gb/s for unidirectional transfers, and 102 Gb/s for bidirectional PCIe transfers Latency for each packet is low: order of magnitude is a few seconds Iperf Iperf Server Server throughput throughput Client Client throughput throughput CPU CPU- -Load low level protocol low level protocol Load for VXFabric for VXFabric Linux Linux benchmark benchmark Server Client Server Client 1 client 1 client 4.28 Gb/s 4.28 Gb/s 4.28 Gb/s 4.28 Gb/s 4 4% % 3% 3% 2 clients 2 clients 5.624 Gb/s 5.624 Gb/s 2.8 2.8 Gb Gb/s /s 6% 6% 3% 3% VXFabric is scalable 32 Gb/s Gen3 16 Gb/s Gen2 8 Gb/s Gen1 PCIe x4 bandwitdh per link MIT Lincoln Laboratory VXFabric-4 Kontron 9/22/2011
VXFabric Conclusion VXFabric high performance switch fabric running on the Kontron VPX Computers The VXFabric API, based on IP Socket, is plug & play for most applications, and does not require any long integration/troubleshooting phase: moving from an Ethernet switch topology to VXFabric is straight forward Have a look to our VXFabric poster and materials at Poster B.7, Demo B:Technologies and Systems THANKS ! MIT Lincoln Laboratory VXFabric-5 Kontron 9/22/2011
