Advanced Testing Infrastructure Development Progress
Progress update on the development and deployment of advanced testing infrastructure for small-grained tests, including examples from targeted components and integration with verification projects. Features include automated test workflows, deployment on GitHub and CDash, and ongoing work on reporting and documentation.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Verification and Testing Infrastructure Epic team: Andreas Wilke, Jason Sarich (ANL), Hui Wan, Kai Zhang, Jian Sun (PNNL) CMDV-SM staff: Irina Tezaur (SNL), Luke Van Roekel, LeAnn Conlon (LANL), Bill Spotz (SNL) Epic description Infrastructure: finish development and deployment of testing infrastructure for small- grained tests. Expand kernel extraction. Verification: continue deployment of examples from targeted components (MAM, Ocean Mixing, and more). Deploy verification project-wide.
Progress: Infrastructure Automated test workflow using cmdv-test-runner (Andreas and Jason) First version available on GitHub Currently working on reporting to Cdash and publishing Jupyter notebooks as html User s guide was deployed and is being updated Alternative workflows using CMake/CTest/CDash (Irina) Multiple examples implemented for verification Will be integrated with the test-runner Nightly testing has been set up on Edison@NERSC and an ANL cluster results on CDash under Experimental Test documentation Written as Jupyter notebooks and converted to html Examples on e3sm-project.github.io
Progress: Verification Examples MAM aerosol module (Jian Sun, Kai Zhang, Hui Wan) Finished water uptake with complete model documentation + Jupyter notebook; currently a key test case for interacting with infrastructure development Very good progress on tests for the next parameterization (condensation), presentation at SIAM GS19 last week, scheme and test documentation being developed Identified a major issue of nudging in E3SMv0, v1; notified E3SM-ALL; many project members were impacted MPAS-Oean (Luke Van Roekel, LeAnn Conlon) first Jupyter notebooks are complete (first-cut) Working on integrating to test-runner
Next steps Improve reporting in test-runner External reporting to dash boards Internal structure, improve cmdv-test-runner output Integrate cmake/ctest to test-runner Integration to E3SM code (not separate, offline pieces) More verification test examples from MAM and MPAS-O
Multiple frameworks under one roof cmdv-test-runner Jupyter notebooks Jenkins cdash local Reporting Python unittest Python pytest Fortran pfUnit cmake / ctest custom tests Testing
> cmdv-test-runner test TESTWF Document and validate Test results reporting
Current work on cmdv-test-runner Reporting Transform and export Current work Create internal report Collect and interpret test output Testing (execute test workflow)
