Securing Sensitive Data Analysis with Galaxy Deployment
Explore how to deploy Galaxy in a secure environment for analyzing sensitive data. Learn about services for sensitive data, Docker containers, two-factor authentication, and running Docker tools from Galaxy containers in a protected setup.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Deploying Galaxy in a secure environment to analyse sensitive data Abdulrahman Azab ELIXIR-NO, EXCELERATE-NO www.elixir-europe.org
Colossus BeeGFS p01 p02 pN Two factor Authentication NFS p01 pN p02
Galaxy as a Docker container
Galaxy Docker Host Container P:8080 P:80 /export/ /home/user/galaxy-export/
Galaxy Docker Host Container2 Container1 /export/ /export/ /home/user/galaxy-export/
tsd/p77 Dockerfile insilico.hpc.uio.no p77-galaxy01-l Container Container image /export/ /export/ Tarball /home/user/galaxy-export/ /galaxy/galaxy-export/ tools Tarball
VM P65 Project Area Container Virtual path Stroll Job Runner /tsd/p65/data Stroll /cluster/ File-system Job Input data Slurm Colossus Job Output data W W W W W W
Running Docker Tools from Galaxy Docker container
TSD VM Project Area Containers Container Tools
TSD VM Project Area Containers Docker Container Tools
Running Docker Tools from Galaxy Docker Container on the Cluster
VM Project Area Docker Container Colossus Slurm Compute Node Compute Node Compute Node Compute Node Docker Engine Docker Engine Docker Engine Docker Engine Pull Docker repositories Local Registry
Galaxy Portal phenotypic data SURFsara cPouta HPC Cloud HPC Cloud TSD HPC storage storage storage genotypic data SFTP Proxy (Tryggve) Data sharing ELIXIR Docker Registry Tool sharing BioShaDock HPC Cluster Compute Node Compute Node Compute Node Compute Node Controller Docker Engine Docker Engine Docker Engine Docker Engine Docker repository
Running Docker Tools from Galaxy Docker Container on the Cluster in the Cloud
VM Docker Container Condor CM HTCondor Pool Docker Engine Compute Node Compute Node Compute Node Compute Node Docker Engine Docker Engine Docker Engine Docker Engine Pull Docker repositories Local ePouta Registry
Run Docker on your own HPC cluster?
SLURM (socker) #!/bin/bash #SBATCH --nodes=1 #SBATCH --partition=docker srun-n 32 sockerbowtie
Swarm is shit Kubernetes and Openshift are not for HPC yet
Issues Containers won t solve the Hardware architecture incompatibility Containers won t clear your operational maintenance mess Must have a valid Linux kernel Image replication for all compute nodes.
