Jobs in the United States

25+ jobs

Save this search

Added 6 mins ago
Lead Software Engineer
Highmark Health
Salem, OR
The job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. The position…
Added 7 mins ago
Senior AI Engineer
Cornell University
Ithaca, NY
…applications are built across the university. The Senior AI Engineer collaborates closely with the Principal Solutions Architect for the AI Platform to define patterns and reference…
Added 14 mins ago
Sr Principal Engineer Systems 4
Northrop Grumman
Ocean Springs, MS
Northrop Grumman is seeking a Sr. Principal Systems Engineer Level 4 to join our team of qualified, diverse individuals. The Marine Systems organization, part of Northrop Grumman Mission…
Added 14 mins ago
Manufacturing Engineer - Engine Test Specialist SG
PACCAR Inc
Columbus, MS
Added 14 mins ago
Lead Software Engineer
Highmark Health
Jackson, MS
The job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. The position…
Added 32 mins ago
Principal Power Electronics Engineer Fuel Cell Systems
Plug Power Inc.
ALBANY, NY
Principal Power Electronics Engineer - Fuel Cell Systems Status: Exempt (salaried) Department: Fuel Cell Platforms - Electrical Engineering Position Summary Plug is building the global…
Added 33 mins ago
NL
High Performance Computing (HPC) AI Engineer
NYU Langone Medical Center
New York, NY
- $101,493.51 to $140,000 USD / year
Collaborate with scientists, principal investigators, and software engineers to deploy customized, scalable AI solutions for complex research challenges.
Added 38 mins ago
Principal Software Development Engineer
Waters Technologies Corporation
Milford, MA
We need your talent! Waters Corporation is currently seeking a DevOps Principal Engineer to joinourGlobal Software Engineering team.
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Houston, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Houston is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Frisco, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Frisco is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Fort Worth, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Fort Worth is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Columbus, OH
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Columbus is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Cleveland, OH
- $129,000 to $150,000 USD / year
An established MEP consulting engineering firm in Cleveland, OH is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on healthcare,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
San Antonio, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in San Antonio is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Plano, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Plano is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Dallas, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Dallas is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Austin, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Austin is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 41 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Cincinnati, OH
- $129,000 to $150,000 USD / year
An established MEP consulting engineering firm in Cincinnati, OH is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on healthcare,…
Added 1 hour ago
Algorithm Development Software Engineer - Level 2 or 3
Northrop Grumman
Boulder, CO
This requisition may be filled at either a Software Engineer – Level 2 or a Principal Software Engineer – Level 3.
Added 1 hour ago
Principal / Sr. Principal DevOps Engineer (AHT)
Northrop Grumman
Aurora, CO
Northrop Grumman’s Space Systems Sector is looking for an experienced Principal Or Sr. Principal DevOps Engineer to augment our team. This position can be based in Aurora, CO, Morrisville,…
Added 1 hour ago
Principal / Sr Principal Cloud Engineer (AHT)
Northrop Grumman
Aurora, CO
Northrop Grumman’s Space Systems Sector is looking for an experienced Principal / Sr Principal Cloud Engineer (AHT) Engineer to augment our team. This position can be based in Aurora, CO,…
Added 1 hour ago
Principal Systems Engineer – Network Sys Engr III (26-388)
Northrop Grumman
Colorado Springs, CO
Northrop Grumman Space Systems - Missile Defense Integration offers an excellent opportunity for a Principal Engineer Systems – Network Sys Engr III (26-388) to join our team of skilled and…
Added 1 hour ago
INTERNAL ONLY: Principal Software Engineer (26-434)
Northrop Grumman
Colorado Springs, CO
Northrop Grumman Space Systems - Missile Defense Integration offers an excellent opportunity for a Principal Software Engineer (26-434) to join our team of skilled and diverse…
Added 1 hour ago
Principal Engineer Software III (26-404)
Northrop Grumman
Colorado Springs, CO
Northrop Grumman Space Systems - Missile Defense Integration offers an excellent opportunity for a Principal Engineer Software III (26-404) to join our team of skilled and diverse…
Added 1 hour ago
Sr. Principal, Product Software Design Quality Engineer
Cardinal Health
Hazelwood, MO
The Product Software Design Quality Engineer provides independent quality oversight throughout the life cycle of medical device software. The role ensures effective software design…

ARM

Principal Software Engineer, AI Inference Cloud

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Dec 31, 2026
Experience: 8+ years of experience, or equivalent proven impact, building distributed systems, cloud platforms, or production infrastructure.
Posting language: English
Posted: Oct 13, 2026

Original job description

As a Principal Engineer on Arm's AI Inference Cloud team, you will shape the technical direction and develop highly available, scalable services for running AI inference workloads. You will guide architecture and actively contribute to development across Kubernetes orchestration, workload management, service delivery, and observability. Partnering with AI compute, Inference Runtime, and product teams to enhance the performance and usability of Arm's AI platform.

Responsibilities:

Define and build the architecture for cloud-based AI inference services.
Develop Kubernetes controllers and platform capabilities supporting workload deployment, scheduling, recovery, scaling, upgrades, and lifecycle management.
Establish production practices for health validation, progressive rollout, rollback, observability, and service objectives. Improve platform reliability, scalability, performance, and resource efficiency.
Lead production readiness reviews and resolve complex issues across services, Kubernetes, networking, and compute infrastructure. Turn incidents and operational bottlenecks into durable platform improvements.
Lead design and build reviews, mentor engineers, and drive technical alignment across teams.

Necessary Skills and Experience:

8+ years of experience, or equivalent proven impact, building distributed systems, cloud platforms, or production infrastructure.
Deep production experience with Kubernetes, including controllers, operators, scheduling, resource management, networking, and workload lifecycle management.
Strong software and production engineering skills, including hands-on programming in Go, C++, Rust, Python, or a similar language, and experience with reliable services, APIs, concurrency, observability, deployment safety, capacity planning, and incident response.
A track record of leading complex technical initiatives while remaining hands-on, including architecture, implementation, debugging, mentoring, and influencing technical direction across teams.
Ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.

Preferred Skills and Experience:

Experience with AI infrastructure, model serving, or accelerator-backed workloads.
Familiarity with frameworks such as PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and tuning distributed workloads.
Knowledge of inference performance and resource-efficiency considerations.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities for AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. Your work will directly impact the success of our AI projects, shape Arm's AI inference capabilities, defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

(Recruiter to Complete)

Additional Information:

Please note that a relocation package (including visa sponsorship support) is available for this role, for candidates who require it.

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens when people are empowered to think bigge To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjQ2NTU2Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job