Staff Software Engineer, AI Compute Platform

As a software Engineer on the AI Compute Platform team, you will design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, working closely with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm's AI workloads.

Responsibilities:

• Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
• Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
• Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
• Improve platform scalability, observability, reliability, and developer workflows.
• Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality.

Essential Skills and Experience:

• 5+ years of experience building distributed systems, cloud platforms, or production backend services
• Experience with distributed ML training or inference systems
• Strong programming skills in Go, Python, or similar systems languages
• Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
• Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
• Clear communication and a collaborative approach to problem-solving.

Desired Skills and Experience:

• Experience with Kubernetes operators, schedulers, resource management, or GitOps or equivalent experience
• Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus and Grafana
• Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM
• Experience delivering developer tools or platform capabilities from early build through production
• Technical leadership, mentoring experience, or an advanced degree or equivalent experience in a related field

In Return:

You will have the opportunity to work on important technical challenges in AI and platform engineering as part of a growing team in Seattle. This position offers a chance to contribute to core platform capabilities. You'll work alongside skilled colleagues from various subject areas and help invent the way new AI services are built and scaled at Arm.

In addition to meaningful technical work, Arm offers an environment that values thoughtful engineering, collaboration, and continuous learning. This opportunity suits someone who enjoys solving complex systems problems, working across teams, and contributing to technology important to the future of AI at Arm. Additional Information Please note that a relocation package (including visa sponsorship assistance) is offered for this role, for candidates who need it.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total rewar To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjI4MjcxLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>