ArmoniK Newsletter - April 2025

Welcome to the third edition of the ArmoniK Newsletter !
As you probably know, ArmoniK is the open source and serverless grid orchestrator that simplifies the development of complex HPC applications on hybrid clouds. Built to modernize your existing grid environment, ArmoniK is simple, robust, scalable, performant ... with no vendor lock-in! This is the reason why Crédit- Agricole CIB has positioned ArmoniK at the heart of its capital markets risk calculations. www.armoniK.fr
In more technical words, ArmoniK is a fault-tolerant, cloud-agnostic serverless platform designed to execute large-scale, dynamic DAG-based workloads, orchestrating High Performant Computes with their data, across private and public clouds. Built on top of Kubernetes, it extends the Function-as-a-Service (FaaS) paradigm to support complex, evolving task graphs while preserving the scalability and elasticity of serverless systems.
Whether you are part of our growing community of users, an ArmoniK partner, or just curious about how you can replace your old grid outdated orchestrator, this newsletter is for you!
I hope you will enjoy reading it 🤩 Feedback is a gift, help us improving the next edition with your suggestions!
What’s New and Evolving
🔧 Native Rust and Java APIs
ArmoniK uses gRPC for communication, making it compatible with all languages supported by gRPC. The ecosystem continues to grow, with pre-compiled and published API bindings now available for Rust and Java. These additions make it easier to integrate ArmoniK into existing applications, allowing developers to harness its full power in their preferred programming languages.
🪟 Windows Workload Support
Originally designed for Linux environments, ArmoniK now supports Windows workloads. This compatibility is enabled through Windows container integration within Kubernetes, including GKE (GCP), EKS (AWS), AKS (Azure). Key benefits include:
-
No need to rewrite existing Windows applications.
-
Incremental adoption of ArmoniK without disrupting current workloads.
-
Performance optimization for native Windows applications.
📦 Simplified Deployment with Terraform
Deploying ArmoniK is now easier thanks to revamped Terraform modules available on our GitHub. This update ensures faster installation and simplified maintenance, tailored for hybrid and multi-cloud environments.
Performance : ArmoniK vs YellowDog
A benchmark test compared ArmoniK and YellowDog under similar AWS conditions, focusing on task throughput using 2,000 workers and 10 million zero-work tasks submitted concurrently by 16 clients:
- ArmoniK: Achieved up to 4,500 tasks per second.
- YellowDog: Reached around 3,000 tasks per second under the same setup.
These results highlight ArmoniK’s superior efficiency in managing high-throughput workloads. A detailed article covering the full benchmark methodology and findings will be published soon.
Documentation and Observability
📖 New Documentation Experience with ReadTheDocs
ArmoniK’s documentation is now centralized and accessible via ReadTheDocs, providing simplified navigation and an improved user experience.
Roadmap
🔜 Short- and Mid-term
- Intent Log: Reinforce system consistency and improve observability through the use of an intent log that records all initiated and completed operatios.
- Optimized Docker Images: Reduce image sizes using "chiseled" images for better security and faster deployment.
- Local Data Cache: Implement a node-level cache system to minimize redundant data transfers.
- Improved User Management: Introduce more granular access controls to meet regulated industry requirements.
🔭 Long-Term Vision
- gRPC API Redesign: Align with gRPC industry best practices for API design and support REST transcoding to simplify integration.
- Advanced Workload Orchestration: Optimize task scheduling based on data locality.
- Data Lifecycle Management: Implement advanced caching strategies to intelligently retain or discard intermediate results.
- Federated Architecture: Enable multiple ArmoniK instances to operate as a unified system, dynamically balancing workloads across on-premise and cloud infrastructures.
- Performance Analysis Tools: Add advanced tools to detect bottlenecks and optimize task execution.
#ArmoniKCommunity
🌐 Join us
ArmoniK is an open-source project under the Apache 2.0 license. Contributions are welcome on our GitHub repository. Stay up to date with the latest news and updates by subscribing to our newsletter on our official website.
Bonus: For more details and to access the full documentation, visit our ReadTheDocs documentation.
Events
Meet Us at the Teratec Forum!
We’re excited to announce that the ArmoniK team will be at the Teratec Forum! Come meet us, discover our latest updates, and discuss high-performance computing, orchestration, and open-source innovation.
We’d love to connect with you there!
Stay informed on ArmoniK
Interested to receive ArmoniK Newsletter few times a year?