Advancing EGI's Strategic Goals with Mini-Projects and Achievements
Delve into EGI's journey towards achieving its strategic goals as detailed in the EGI-InSPIRE reviews. Explore the mini-projects undertaken, their impact on advancing EGI's mission, and the key achievements highlighted. Gain insights into the prioritization of proposals, negotiations, funding decisions, and effective management structures in place. Uncover the innovative initiatives such as Massive Open Online Course Development, Evaluation of Liferay modules, and more contributing to EGI's success.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
EGI-InSPIRE SA4: Advancing EGI s Strategic Goals Michel Drescher Technical Manager, EGI.eu EGI-InSPIRE PY4 review 1 3/5/2025 www.egi.eu www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE RI-261323
Outline Introduction Mini Projects Achievements Conclusions EGI-InSPIRE PY4 review 2 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Outline Introduction Mini Projects Achievements Conclusions EGI-InSPIRE PY4 review 3 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
A brief history of time Funding decision & setup of WP8 EGI reviews strategic Goals Prioritization of proposals, negotiations Call for mini projects Sep 12 Dec 12 Jan 13 Apr 13 EGI-InSPIRE PY4 review 4 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
WP structure Formal integration with EGI-InSPIRE Inherit management and funding schemes Management through existing WPs WP management, shepherds Mini projects treated as project tasks Formal semester reporting (MS801, D8.1) EGI-InSPIRE PY4 review 5 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Leadership Administrative WP management Weekly reporting, QRs, Periodic reports Domain shepherd leadership Aligned with other WPs and EGI Platforms Mini project management As much freedom as possible Minimal invasive formal requirements EGI-InSPIRE PY4 review 6 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Outline Introduction Mini Projects Achievements Conclusions EGI-InSPIRE PY4 review 7 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Mini projects TSA4.2: Massive Open Online Course Development TSA4.3: Evaluation of Liferay modules TSA4.4: Providing OCCI support for arbitrary Cloud Management Frameworks TSA4.5: CDMI Support in Cloud Management Frameworks TSA4.6: Dynamic Deployments for OCCI Compliant Clouds TSA4.7: Automatic Deployment and Execution of Applications using Cloud Services TSA4.8: Transforming Scientific Research Platforms to Exploit Cloud Capacity TSA4.9: VO Administration and operations PORtal (VAPOR) TSA4.10: A new approach to Computing Availability and Reliability Reports TSA4.11: GOCDB Scoping Extensions and Management Interface TSA4.12: Tools for automating applying for and allocating federated resources EGI-InSPIRE PY4 review 8 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Mapping to EGI strategic pillars TSA4.8 Cloud Porting TSA4.2 MOOC TSA4.3 Liferay TSA4.7 App Deploy TSA4.6 Dyn. OCCI TSA4.4 OCCI TSA4.5 CDMI TSA4.11 GOCDB Ext. TSA4.10 ARGO TSA4.9 VAPOR TSA4.12 e-GRANT 2nd ISO JTC1 Workshop 9 14 May 2014 www.egi.eu EGI-InSPIRE RI-261323
Outline Introduction Mini Projects Achievements Conclusions EGI-InSPIRE PY4 review 10 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.2: Massive Open Online Course Development Course material prepared March 2013 November 2013 Course taught successfully 18th of November 2013 to January 2014 Participation 350 attendants 30 acquired certification 60% of course assignments and 60% of all assignments Course material available on YouTube Use cases: http://go.egi.eu/MOOC-UseCases Lectures: http://go.egi.eu/MOOC-Lectures EGI-InSPIRE PY4 review 11 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.3: Evaluation of Liferay modules High-level objectives Evaluate Liferay as alternative for current EGI.eu back-office E.g. EGI.ey website CRM, DocDB, Evaluate Liferay as a collaboration service for VREs Liferay 6 including Sync & Social Office successfully evaluated Full evaluation report: https://documents.egi.eu/document/1737 Outcomes (summary): Liferay may replace some back-office services, but not all Liferay may be used and provided as a service to VREs EGI-InSPIRE PY4 review 12 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.4: Providing OCCI support for arbitrary Cloud Management Frameworks Thorough assessment of then existing rOCCI tool Promising tool, yet prototype Improve design & architecture of rOCCI framework Modularity, extensibility, usage Implement two framework instances rOCCI-server rOCCI-client Deploy rOCCI-server in the EGI Federated Cloud Deployed at all OpenNebula instances! rOCCI-server backends planned/discussed for: Apache CloudStack (in progress) StratusLab (discussed) VMWare vServer (discussed) rOCCI-client used in numerous community applications and integrations E.g. Catania Science Gateway Framework jSAGA-OCCI implementation E.g. EUBrazilOpenBio Available in AppDB rOCCI-cli: https://appdb.egi.eu/store/software/rocci.cli rOCCI-server: https://appdb.egi.eu/store/software/rocci.server EGI-InSPIRE PY4 review 13 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.5: CDMI Support in Cloud Management Frameworks CDMI-compliant backend server Supports flat-file backend Supports OpenStack Swift backend Integrate with EGI Federated Cloud AAI Support VOMS-backed Keystone security tokens CDMI probe developed for EGI Monitoring subsystem CDMI Python SDK Including CDMI cli using the SDK SwaggerUI Simple browser-based CDMI UI Deployed in EGI Federated Cloud infrastructure EU project Strategic chose this solution for inclusion EGI-InSPIRE PY4 review 14 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.6: Dynamic Deployments for OCCI Compliant Clouds Preliminary OCCI connector for Slipstream Used with ESA use case deployment in EGI Specific deployment recipe re-usable for any Cloud configured in a Slipstream instance Production OCCI connector for Slipstream Had to wait for Slipstream v2 Financial procedure issues delayed the completion of this work Monitoring probe currently developed Allows integrating Slipstream as broker solution for VREs EGI-InSPIRE PY4 review 15 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.7: Automatic Deployment and Execution of Applications using Cloud Services Extend OCCI API with contextualisation capability Two OCCI mixins define contextualisation functions Implement said OCCI extension using cloud-init Team used OpenStack OCCI plugin Code available in mainstream codebase Vanilla cloud-init supports OpenStack Customised cloud-init for OpenNebula https://appdb.egi.eu/store/software/fedcloud.cloud.init Supported by popular configuration solutions, e.g. Puppet Application Deployment service for scientific use cases Uses OCCI contextualisation implemented before Leverages popular scientific applications Provides re-usable deployment recipes Integrated with EGI AAI Early adopter communities Ibergrid Particle Physics Ibergrid Computational Chemistry EGI-InSPIRE PY4 review 16 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.8: Transforming Scientific Research Platforms to Exploit Cloud Capacity Software engineering design patterns for scientific Cloud applications Common issues in scientific domain VM images Literal clones of Laptop hard drives Store data local for performance, or remote? How to create small VM images (for swift startup?) How to keep VM images small? Fully documented patterns How to create small VM images How to keep VM images small How to configure MySQL in a VM to use external storage EGI-InSPIRE PY4 review 17 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.9: VO Administration and operations PORtal (VAPOR) Web-based VO admin service Resource status dashboards Operational reports VO data management Community users management Early adopter deployment in November 2013 Resource status dashboards Operational reports Community management module not released Unexpected challenges delayed the schedule for 4 months VAPOR in production since January 2014 Biomed, <<<add other VOs>>> EGI-InSPIRE PY4 review 18 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.10: A new approach to Computing Availability and Reliability Reports Overhaul A/R computing component in SAM Long-term plan to replace old ACE engine Product owner: OMB A/R Task Force Pilot deployment in August 2013 Using GRNET s ~okeanos Cloud Continuous results validation Diff. in the range (abs.) 0% < <= 1% 1% < <= 2% 2% < <= 5% 5% < <= 10% 10% < <= 20% > 20% No. of compared sites (Avail.) 222 46 41 4 1 0 314 (Rel) 227 41 38 6 1 1 314 Production in January 2014 Operate in same condition as ACE Computation Cluster mode Local mode Aggregation profiles Custom topologies Custom corr. Factors Idempotent calculations EGI-InSPIRE PY4 review 19 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.11: GOCDB Scoping Extensions and Management Interface Extend scoping of GOCDB Beyond EGI and local 6-month mini project GOCDB as a service One instance hosts multiple customers (incl. EGI) Flexible resource tagging (c.f. labels in Gmail) Features in production with GOCDB 5 Since October 2013 EGI-InSPIRE PY4 review 20 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
TSA4.12: Tools for automating applying for and allocating federated resources Develop service backing the Resource Allocation Task Force e-GRANT service First version operational in November 2013 Used for first round of resource requests (http://go.egi.eu/resreq-1) Version 1.5 deployed in January 2014 Integrated with EGI AAI and GOCDB v5 Version 2 deployed in March 2014 Includes resource brokering, SLAs EGI-InSPIRE PY4 review 21 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Outline Introduction Mini Projects Achievements Conclusions EGI-InSPIRE PY4 review 22 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Resource consumption WP8 total: 94% Per-task consumption mostly on target Within bracket of +- 20% Some exceptions were dealt with appropriately EGI-InSPIRE PY4 review 23 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Mini project closures Available for each mini project Recorded in D8.1 Triggers mental end of mini project Provides 360 retrospection For mini project teams to self-reflect For EGI management as feedback EGI-InSPIRE PY4 review 24 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
Main conclusions 1. Splitting administration & domain leadership Provides clear ownership and responsibilities Ensures grounding of project teams 2. Carefully manage voluntary effort 1. Be proactive with including SMEs in mini projects EGI-InSPIRE PY4 review 25 3/5/2025 www.egi.eu EGI-InSPIRE RI-261323
