Senior Software Engineer, AI Inference Platform - Cerebras Systems

View Company Profile

Job Title

Senior Software Engineer, AI Inference Platform

Job Location

Sunnyvale CA or Toronto Canada

Job Listing URL

https://job-boards.greenhouse.io/cerebrassystems/jobs/6557508003

Job Description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.

Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.

About The Role

We are seeking a talented Platform Software Engineer to join the team building the Cerebras Inference Platform. You will be instrumental in designing, developing, and operating the core backend services and APIs that power the Inference platform. You'll build the software that allows customers to seamlessly deploy, manage, and serve inference workloads on dedicated Cerebras hardware.

Responsibilities:

Design, build, and maintain the core APIs for the Inference Platform, handling model catalog management, deployment of ML workloads, scaling, and status monitoring.

Focus on building platform capabilities that optimize for ease-of-use, robustness, and self-service access to inference models and serving.

Collaborate with infrastructure and ML engineering teams to ensure high reliability, uptime, and smooth user interactions with the inference service

Design and implement features like multi-tenant support, deployment automation, priority queuing, and caching strategies for user requests.

Build robust observability features by integrating with monitoring and telemetry tools (e.g., Prometheus, Grafana) to track system health, performance metrics, and request analytics.

Skills & Qualifications:

Bachelor’s or Master's degree in computer science or related field, or equivalent practical experience.

5+ years of experience in backend software development, with a focus on service APIs, orchestration platforms, or user-facing infrastructure.

Strong proficiency in Python (C++ is good to have).

Experience designing, building, and integrating with RESTful APIs and gRPC services

Solid understanding of distributed systems concepts such as concurrency, scalability, and fault tolerance

Hands-on experience with containerization (Docker) and orchestration frameworks (Kubernetes)

Experience with databases and caching systems (e.g., Postgres, Redis).

Experience with observability, telemetry pipelines, and system monitoring best practices.

Strong problem-solving and debugging abilities

Excellent communication and cross-functional collaboration skills

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.

Read our blog: Five Reasons to Join Cerebras in 2025.

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

View Job Listing