DevOps Engineer, HPC Services - Mistral

Job Title: DevOps Engineer, HPC Services
Job Location: Paris
Job Listing URL: https://jobs.lever.co/mistral/d60f6c60-ad5e-4753-af8a-56365b7db8b8
Job Description: About Mistral

At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.

We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.

We are a dynamic, collaborative team passionate about AI and its potential to transform society.
Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.

Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.

Role Summary

We are building one of Europe’s largest AI infrastructure offering that will provide our customers a private and integrated stack in every form factor they may need — from bare-metal servers to fully-managed PaaS. As a DevOps Engineer, you will join a fast growing team to help building, scaling and automating our computing management stack. You will be responsible for building fault-tolerant and reliable infrastructure to support both our internal processes and customer platform.

Location: France 🇫🇷 and UK 🇬🇧 as primary location, or remote under conditions (see below)
Reporting line: Software Architect, HPC

What you will do

As a DevOps Engineer in the HPC services team, your primary responsibility will be to engineer robust and dependable infrastructure that supports both our internal operations and customer-facing platforms.

Key Responsibilities:

• Design, build and maintain scalable, highly available and fault-tolerant infrastructures
• Build, scale and automate the full lifecycle of compute nodes, from bootstrapping to decommissioning
• Design and develop new workflows and tooling to improve to the reliability, availability and performance of our systems (automation scripts, API-based features, web apps, dashboards, etc.)
• Drive continuous improvement in infrastructure automation, deployment, and orchestration (CI/CD, containerization, orchestration, monitoring, logging and alerting systems...)
• Operate systems and troubleshoot issues in production environments (interrupts, on-call responses, users admin, data extraction, infrastructure scaling, etc.)
• Participate occasionally in on-call rotations to respond to incidents and perform root cause analysis to prevent future occurrences
• Collaborate closely with R&D to streamline build systems, scale testing workflows and make sure our inference and model training environments are always highly available and seamlessly replicable across several HPC clusters
• Collaborate with the security team to ensure infrastructure adheres to best security practices and compliance requirements

About you

• 7+ years of experience in a DevOps/SRE role
• Exposure to highly available distributed systems and site reliability issues in critical environments (issue root cause analysis, in-production troubleshooting, on-call rotations...)
• Proficiency in scripting languages (Python, Go, Bash...) and knowledge of software development best practices
• Hands-on experience with CI/CD, containerization and orchestration tools (Docker, Kubernetes..)
• Proven experience troubleshooting complex K8s cluster issues and performing system upgrades
• Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
• Knowledge of monitoring, logging, alerting and observability tools (Prometheus, Grafana, ELK Stack, Datadog...)
• Experience working against reliability KPIs (observability, alerting, SLAs)
• Strong understanding of networking, security, and system administration concepts
• Excellent problem-solving and communication skills
• Self-motivated and able to work well in a fast-paced startup environment

Now, it would be ideal if you also had experience with:
• HPC workload managers (Slurm)
• Distributed storage systems (Lustre, Ceph)