Next-Generation Cloud Computing Technologies
Explore the latest advancements in cloud computing technologies such as dynamic resource allocation, microservices, Docker ecosystem integration, Heroku-inspired frameworks, Mesosphere OS, Mesos scheduling, and various data processing frameworks like Aurora, Marathon, and more. Discover how these technologies are revolutionizing the way applications are developed and deployed across public and private clouds.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
INDIGO DataCloud PaaS activities @INFN RIA-653549 marica.antonacci@ba.infn.it INFN-Bari
Paradigm shifts From static partitioning to dynamic resource allocation Improve resource utilization Improve scalability and fault tolerance From Monolithic App to Microservices Easier to develop Easier to scale Fault isolation From VMs to Containers Run your application (even legacy) everywhere: on public and private clouds INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Docker ecosystem in Openstack Heat Heat Solum Solum Kubernetes Kubernetes Docker Docker Magnum Magnum OpenShift OpenShift CloudFoundry CloudFoundry INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Heroku-inspired frameworks Deis builds upon Docker lightweight PaaS Build/Release/Run Docker and CoreOS CoreOS to provide a Similar solutions: flynn, tsuru INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Mesosphere Mesosphere offers a layer of software that organizes your machines, VMs, and cloudinstances and lets applications draw from a single pool of intelligently- and dynamically-allocated resources, increasing efficiency and reducing operational complexity The Mesosphere Operating System Stack Key Concept: Data Center Operating System Data Center Operating System Rails Redis Elasticsearch Memcached Applications Marathon Init System Mesos Kernel INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Mesos Two-Level Scheduling INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Mesos Frameworks Long Long Running Running Services Aurora, Marathon, Singularity, SSSP Big Data Processing Big Data Processing Cray Chapel, Dpark, Exelixi, Hadoop, Hama, MPI, Spark, Storm Batch Batch Scheduling Scheduling Chronos, Jenkins, JobServer, Torque Data Storage Data Storage Cassandra, ElasticSearch, Hypertable Services INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Cluster configuration - example INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Conclusions Preliminary tests Deis: Installation is simple, but takes too long (~1h for 5 nodes cluster) Poor stability Debugging not so easy Supported apps: twelve-factors, only ONE HTTP port Mesos: Easy to deploy Packages available for Debian/Ubuntu and Redhat/Centos Automatic provisioning available Easy to scale INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Backup Slides INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Service Discovery Mesos Mesos- -DNS application in the Mesos datacenter knowing only its name can be made fault-tolerant by launching with a framework like Marathon, that can monitor application health and re-launch it on failures. Marathon SD Marathon SD allows easy network communication between services Based on HAProxy TCP/HTTP load balancer plus an assistant script that uses Marathon s REST API to periodically re- generate a HAProxy configuration file DNS (alpha) allows to connect to an INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 653549
Applications in Marathon JSON app definition curl -X POST -H "Content-Type: application/json" http://<master>:8080/v2/apps -d@app.json Marathon hands over execution to Mesos. Mesos executes each task in its own sandbox environment INDIGO INDIGO- -DataCloud RIA DataCloud RIA- -653549 Marathon knows how to handle application resources 653549
