Advanced PaaS Platform Development for Scientific Communities
Explore the development of a powerful PaaS layer enabling scientific communities to leverage diverse computing and data infrastructures efficiently. Focus on transparency, error management, and elasticity, with contributions from various partners.
Uploaded on | 1 Views
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
INDIGO DataCloud WP5 introduction RIA-653549 Giacinto.Donvito@ba.infn.it INFN-Bari lukasz.dutka@cyfronet.pl CYFRONET
WP5 session agenda WP5 Highlights Most critical issues Timeline and Deadline Partner experience and interest Next steps and how we can proceed 2 2 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: PaaS Platform Development 3 3 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549 Figure 14: WP5 architecture
WP5: PaaS Platform Development Task: 5.1 Task: 5.1 Blanquer Task Leader: Ignacio Task Leader: Ignacio Blanquer iblanque@dsic.upv.es iblanque@dsic.upv.es PaaS PaaS architecture and implementation architecture and implementation Design and implementation of a PaaS layer allowing scientific communities to exploit, in a powerful and high-level way, several heterogeneous computing and data e heterogeneous computing and data e- -infrastructure Cloud, Helix Nebula, EGI Grid, EGI Federated Cloud, PRACE, HPC, EUDAT, etc. It will be possible to process large amounts of data and to exploit the efficient storage and preservation technologies and infrastructure already available in the European e- infrastructure, with the appropriate mechanisms to ensure security and privacy. Implementation of an advanced PaaS Layer providing the following features: Transparency Error management Elasticity/SLA management. several infrastructure such as: IaaS large amounts of data Partner involved: Partner involved: Lead Partner: UPV [30 PMs] Lead Partner: UPV [30 PMs] Contributors Contributors: INFN [25 PMs], CISC [15 PMs], CERN [10 PMs], STFC [15 PMs], T-System [20 PMs], ATOS [20 PMs], INDRA [15 PMs], Reply [35 PMs] 4 4 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: PaaS Platform Development Task: 5.2 Task: 5.2 Task Leader: Andrea Task Leader: Andrea Ceccanti Andrea.ceccanti@cnaf.infn.it Andrea.ceccanti@cnaf.infn.it Ceccanti Security and Security and Authorization Will focus on authorization issues authorization issues in distributed, multi-tenant cloud infrastructures cloud infrastructures, leveraging and integrating with standard and already available authentication technologies (e.g., X.509, SAML2, OpenID OpenID- -Connect Connect). user identities, enrollment and attribute management (e.g., group membership management, role assignment membership management, role assignment); access policy definition policy definition, distribution and composition; controlled privilege delegation privilege delegation; credential credential translation translation. Authorization X.509, SAML2, group Partner involved: Partner involved: Lead Partner: INFN [51 PMs] Lead Partner: INFN [51 PMs]; deputy: CESNET [13 PMs] Contributors Contributors: CSIC [15 PMs], KIT [11 PMs], CERN [10 PMs] 5 5 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: PaaS Platform Development Task: 5.3 Task: 5.3 Task Leader: Task Leader: Giacinto Giacinto.donvito@ba.infn.it Giacinto.donvito@ba.infn.it Giacinto Donvito Donvito High High- -level geographical application/service deployment level geographical application/service deployment will implement a solution, Geo Geo- -deployment Service deployment Service, to deploy in a transparent and powerful way both services and applications distributed and heterogeneous environment made by several different infrastructures (EGI Grid, EGI Fed Cloud, IaaS Cloud, Helix Nebula, PRACE, local HPC clusters, etc). well beyond the simple scheduling beyond the simple scheduling of the application over grid or cloud environments because it will provide the capabilities to deploy a wide range of diverse applications and services wide range of diverse applications and services with a powerful set of APIs that hide the complexity of the underlying infrastructures Partner involved: Partner involved: Lead Partner: INFN [35 PMs] Lead Partner: INFN [35 PMs] Contributors Contributors: IBCH PAS [6 PMs], AGH/AGH-UST [30 PMs], UPV [15 PMs], T-Systems [10 PMs], ATOS [10 PMs], INDRA [15 PMs], Reply [10 PMs]. services and applications in a 6 6 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: PaaS Platform Development Task: 5.4 Task: 5.4 Task Leader: Lukasz Task Leader: Lukasz Dutka lukasz.dutka@cyfronet.pl lukasz.dutka@cyfronet.pl Dutka Unified Data Unified Data Access Unification Federated data access Interoperability and Open Data Optimization and Data on the fly Access Partner involved: Partner involved: Lead Partner: AGH/AGH Lead Partner: AGH/AGH- -UST [60PM]; deputy: DESY [30PM] Contributors: Contributors: INFN [25PM], IBCH PAS [14PM], INAF [15PM] UST [60PM]; 7 7 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: PaaS Platform Development criticalities There are at least three tasks that has a quite big impact also on the others WPs PaaS PaaS core core AAI AAI Storage access Storage access For this reason we have separate session for them 8 8 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: Tasks Task T5.1: Task T5.1: PaaS Subtask T5.1.1 [M1-M4] (July 2015) PaaStechnologies This task will perform the analysis of the technologies, standards and requirements from the community to implement the PaaS layer. This task will end up with deliverable D5.1 (M5.1) comprising the analysis of the available technologies, focusing on the features needed by the INDIGO community, finally enabling to select them in the design of the PaaS architecture. Subtask T5.1.2 [M3-M6] (Sept (Sept 2015) 2015): Design of the PaaSArchitecture This task has to define the components to be used, the global PaaS architecture, the interface with the upper (WP6) and lower (WP4) layers, the unit tests, and the evaluation metrics. This task will end up with the deliverable D5.2 (M5.2) comprising the first comprehensive design of the PaaS layer and the concrete metrics to evaluate it. PaaS architecture and implementation architecture and implementation (July 2015): Analysis and state of the art of 9 9 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: Tasks Task T5.2: Security and Authorization Task T5.2: Security and Authorization Subtask T5.2.1 [M1-M6] (Sept 2015) services design This task will focus on groundwork activities, such as the definition of supported federated authentication mechanisms, the definition of the privilege delegation mechanism and the structure of the security token (working in close collaboration with WP4 and WP6). The IAM service functionalities and APIs will also be defined (user and attribute management, policy authoring and distribution functionalities, attribute authority and credential translation services). This task will also perform an evaluation of existing technologies to use as the basis of the IAM services implementation. The results of this task will be the design of the IAM services which will be described in deliverable D5.1 and D5.2. (M5.1, M5.2). (Sept 2015): Requirements analysis and IAM 10 10 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: Tasks Task T5.3: Task T5.3: High deployment deployment Subtask T5.3.1 [M1-M5] (Aug 2015) scheduling algorithms This subtask will provide a report of current technologies with their application areas, functionalities, supported protocols and so on. Thanks to this scouting activity, we will be able to define the solutions to be adopted, the strategy to integrate them and the novel features to develop according to project requirements. The results of this task will be part of the Milestone M5.1. Subtask T5.3.2 [M1-M6] (Sept 2015) (Sept 2015): Definition of the Geo- deployment Service architecture Geographical scheduling, deployment and execution of Service/Application represent the main functionalities of the service proposed in T5.3, since they have to ensure the optimized execution of all the tasks required by an High- -level geographical application/service level geographical application/service (Aug 2015): Requirements of application 11 11 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: Tasks Task T5.4: Task T5.4: Unified Subtask T5.4.1 [M1-M5] (Aug Unified Data Access This task will overview the state of the art of technologies used for unification of data access. The available technology will be evaluated on the basis of the requirements coming from user-communities. As a result, a selection of technology used for development UDA will be made as input to deliverable D5.1 (M5.1). Subtask T5.4.2 [M3-M6] (Sept (Sept 2015) 2015): Initial design and provisioning of Unified Data Access This task will be involved in preparation of the initial architecture of Unified Data Access subsystem. As a result, a design of the set of components and their architecture, initial set of interfaces, set of dependencies to components developed by other work packages will be provided. It will make input to deliverable D5.2 (M5.2). Unified Data Data Access Access (Aug 2015) 2015): Requirements and Plans for 12 12 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: Milestones and Deliverable D5.1, Month 5 D5.1, Month 5 (R, PU) (Aug 2015) technologies at the base of PaaSarchitecture [UPV] Provide an overview of the state of the art technologies used as base for the PaaS architecture. The technologies will be evaluated on the bases of the requirements coming from user-communities and on the requirement analysis from WP2 and WP6. D5.2, Month 6 D5.2, Month 6 (R, PU) (Sept 2015 (Sept 2015) ): Design Document and work plan for the PaaSarchitecture [Cyfronet|INFN] This deliverable contains the detailed design document and the resulting work plan of the technical area, compliant with the overall Technical Development Plan including WP4 and WP6. (Aug 2015): State of the art for the 13 13 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
WP5: Task, milestones and Deliverable M5.1 M5.1 [Month 5] (Aug 2015) evaluated and building blocks selected. M5.2 M5.2 [Month 6] (Sept 2015) (Sept 2015): Architecture of the PaaSlayer designed and documented. (Aug 2015): PaaSlayer available-technology D1.6 D1.6 Month 6 (R, PU) (Sept 2015) [INFN] This deliverable will describe the general architecture of INDIGO produced by the collaborative work of WP4, WP5 and WP6. WP1 oversees the Technical Board of the project (see governance section) and therefore takes the responsibility of delivering the General Architecture deliverable on behalf of all the JRA work packages. (Sept 2015): General Architecture General Architecture 14 14 INDIGO INDIGO- -DataCloud DataCloud RIA RIA- -653549 653549
