HPC Workload Migration and Optimization to AWS

Deeplife

AWS Migration Cloud Industry & Services

Publié le 23 mai 2024

Context

DeepLife develops novel approaches to drug discovery based on state-of art multi-omics data, machine learning, and system engineering.

Their growing computational needs were held back by outdated orchestration paradigms running on-premises resources.

Aneo was mandated to analyze their HPC workloads and propose and execute a plan to migrate them to AWS.

Objectives

Aneo has accompanied DeepLife on a journey that has brought them from executing Snakemake workflows on an on-premises Slurm cluster, to functionally equivalent Nextflow workflows executed on a tailor-designed architecture on AWS.

Production workload continuity has been ensured during development with a custom-made AWS-Snakemake executor that allows to run Snakemake workloads on AWS without the need of third-party software.
The now legacy workflows did not have fast and reliable access to genomic data sources. As part of the new orchestration design, Aneo has implemented the means to reliably procure genonic data from DeepLife selected providers.

Results

A new scalable, secure, reliable, optimized and available architecture on AWS designed for big genomics computing pipelines.
Reduced workload orchestration overhead leading to a significant reduction of computing times.
A secure, fast and easy to use system to download genomic data from remote archives.

Ready to change how you work?

In the spotlight

Accelerating LLMs on AWS Cloud for bioinformatics

06 June 2024 Artificial intelligence

Industry & Services

Aneo supported a bioinformatics company specializing in genAI/LLMs, in optimizing its AWS cloud infrastructure and AI processes to accelerate drug discovery.

Cloud migration to accelerate drug discovery with AWS

23 May 2024 AWS Migration

Industry & Services

Owkin is a leading biotechnology company specializing in the application of Artificial Intelligence (AI) and Machine Learning (ML) for drug discovery.

Optimizing computing power for tomorrow's medicines with AWS

23 May 2024 AWS Migration

Industry & Services

As part of the design of tomorrow's medicines, Mnemo has a need to satisfy its requirements for intensive computing orchestration power of more than tens of thousands of instances on cloud computing grids.

HPC Workload Migration and Optimization to AWS

Context

Objectives

Results

Ready to change how you work?

In the spotlight

Newsletter