New Storage Services and System Refresh at LLNL-PRES-2003532
Explore the latest updates at LLNL-PRES-2003532, including new storage services for SCF and RZ Vast systems, Vast DB functionalities, and the deployment of LC's S3 service. Learn about the Vast systems, server refresh initiatives, and more. Stay informed about the cutting-edge technology and services being implemented.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
LC NAS Services March 2025 Dave Fox, LC Systems Administration Group 1 LLNL-PRES-2003532
New and Update Storage Services SCF and RZ Vast system Vast DB LC s S3 service Refresh of /usr/workspace servers 2 LLNL-PRES-2003532
Vast Systems CZ / RZ Vast One set of servers 16 Cnodes- client connections 100Gb Ethernet 14 Dnodes data storage 44 16TB SSD per HA node pair NEW NEW -RZ /p/vast1 just deployed last week ~ 1 PB SCF Vast ~ 2 PB 24 Cnodes client connections 100Gb Ethernet 24 Dnodes data storage 11 16TB SSD per HA node pair Default quota the same for all systems, 20TB and 1M files. 3 LLNL-PRES-2003532
Vast DB Vast more than just a storage server, they are delivering numerous data services. The VastDB interface is a SQL like interface to tables of data uploaded to the system. Not the normal POSIX files. Queries can be made with Python or Trino (open-source parallel query engine) - Center for Predictive Bioresilience Also testing S3 on Vast Let us know if you have any possible use cases 4 LLNL-PRES-2003532
LCs S3 Service Amazon S3 compatible storage service deployed with the Persistent Data Services environment (see Learn more at: hpc.llnl.gov/cloud). Available in CZ, RZ, SCF. Open side is now enabled to allow S3 access from outside of LC, enables movement of data in/out of LC (ieimage capture from an experiment into LC for analysis/ML), fully automated. In the future, plan to have S3 available from Vast and HPSS. LLNL Enterprise Network LC Network S3 object (get, put, delete) via https keys managed via LaunchIT 5 LLNL-PRES-2003532
Refresh of Workspace servers Started CZ/RZ refresh last year 1 of 4 server pairs replaced. Waiting on budget approvals to do additional procurements New servers are all flash based 6 LLNL-PRES-2003532
