Advanced Computing for Research with EGI Foundation
Explore the integration status of HTCondor in the EGI framework, funded by the European Commission. Learn about completed and ongoing steps, including underpinning agreements, configuration management, monitoring, support, and security procedures.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
EGI: Advanced Computing for Research www.egi.eu @EGI_eInfra HTCondor integration in EGI Status The work of the EGI Foundation is partly funded by the European Commission under H2020 Framework Programme
The integration procedure https://wiki.egi.eu/wiki/PROC19 Integration steps for the new technology: Underpinning Agreement Configuration management Information System Monitoring Operations (ROD) Dashboard Support Accounting UMD VM image Marketplace Documentation Security www.egi.eu @EGI_eInfra 2 21/03/2025
HTCondor-CE integration status Completed steps Underpinning Agreement Configuration management (GOCDB) Service type already present: org.opensciencegrid.htcondorce Support: the GGUS SU is HTCondor-CE Defined the interactions between GGUS and Condor RT system Security: Security questionnaire sent to EGI CSIRT www.egi.eu @EGI_eInfra 3 21/03/2025
HTCondor-CE integration status Steps not completed yet Information System: the info-provider available: https://github.com/opensciencegrid/htcondor- ce/tree/master/contrib/bdii GLUE2 information only To test during the staged rollout Monitoring: Marian Babik released nagios probes for direct submission to Condor-CE: ohttps://gitlab.cern.ch/etf/jess oTo install on ARGO test instances oThe probes submit jobs to CREAM-CE and ARC-CE as well Operations Dashboard: To set the operations test once the nagios probes are in production Documentation www.egi.eu @EGI_eInfra 4 21/03/2025
Accounting: Previous integration work by Stephen Jones (Liverpool) and PIC: o https://twiki.cern.ch/twiki/bin/view/LCG/HtCondorCeAccounting APEL 1.8.0-1 adds support for a cputmult scaling factor. o Liverpool site managed to publish accounting records o Involved few other sites for testing the accounting working on a related requirement to add support for setting of benchmarks in the local APEL client config so that the dependency on the BDIIs can be removed. UMD: https://wiki.egi.eu/wiki/UMD_products_ID_cards HTCondor-CE is released with HTCondor in a version without the dependencies on other OSG software o HTCondor-CE depends on HTCondor (though not for use as a batch scheduler), so both packages will need to be distributed Verification ongoing: o Ansible files for service configuration www.egi.eu @EGI_eInfra 5 21/03/2025
EGI: Advanced Computing for Research Thank you for your attention. Questions? The work of the EGI Foundation is partly funded by the European Commission under H2020 Framework Programme www.egi.eu This work by the EGI Foundation is licensed under a Creative Commons Attribution 4.0 International License. @EGI_eInfra
