Jobs in the United States

25+ jobs

Save this search

Added 5 mins ago
Principal Software Development Engineer
Waters Technologies Corporation
Milford, MA
We need your talent! Waters Corporation is currently seeking a DevOps Principal Engineer to joinourGlobal Software Engineering team.
Added 7 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Houston, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Houston is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 7 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Frisco, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Frisco is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 7 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Fort Worth, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Fort Worth is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 7 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Columbus, OH
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Columbus is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 7 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Cleveland, OH
- $129,000 to $150,000 USD / year
An established MEP consulting engineering firm in Cleveland, OH is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on healthcare,…
Added 8 mins ago
G
Senior Mechanical Engineer, PE
GPAC
San Antonio, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in San Antonio is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 8 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Plano, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Plano is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 8 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Dallas, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Dallas is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 8 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Austin, TX
- $135,000 to $155,000 USD / year
An established MEP consulting engineering firm in Austin is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on data center,…
Added 8 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Cincinnati, OH
- $129,000 to $150,000 USD / year
An established MEP consulting engineering firm in Cincinnati, OH is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on healthcare,…
Added 50 mins ago
Algorithm Development Software Engineer - Level 2 or 3
Northrop Grumman
Boulder, CO
This requisition may be filled at either a Software Engineer – Level 2 or a Principal Software Engineer – Level 3.
Added 50 mins ago
Principal / Sr. Principal DevOps Engineer (AHT)
Northrop Grumman
Aurora, CO
Northrop Grumman’s Space Systems Sector is looking for an experienced Principal Or Sr. Principal DevOps Engineer to augment our team. This position can be based in Aurora, CO, Morrisville,…
Added 50 mins ago
Principal / Sr Principal Cloud Engineer (AHT)
Northrop Grumman
Aurora, CO
Northrop Grumman’s Space Systems Sector is looking for an experienced Principal / Sr Principal Cloud Engineer (AHT) Engineer to augment our team. This position can be based in Aurora, CO,…
Added 50 mins ago
Principal Systems Engineer – Network Sys Engr III (26-388)
Northrop Grumman
Colorado Springs, CO
Northrop Grumman Space Systems - Missile Defense Integration offers an excellent opportunity for a Principal Engineer Systems – Network Sys Engr III (26-388) to join our team of skilled and…
Added 50 mins ago
INTERNAL ONLY: Principal Software Engineer (26-434)
Northrop Grumman
Colorado Springs, CO
Northrop Grumman Space Systems - Missile Defense Integration offers an excellent opportunity for a Principal Software Engineer (26-434) to join our team of skilled and diverse…
Added 50 mins ago
Principal Engineer Software III (26-404)
Northrop Grumman
Colorado Springs, CO
Northrop Grumman Space Systems - Missile Defense Integration offers an excellent opportunity for a Principal Engineer Software III (26-404) to join our team of skilled and diverse…
Added 53 mins ago
Sr. Principal, Product Software Design Quality Engineer
Cardinal Health
Hazelwood, MO
The Product Software Design Quality Engineer provides independent quality oversight throughout the life cycle of medical device software. The role ensures effective software design…
Added 56 mins ago
R
Senior Principal Engineer, Software Engineering
RTX
United States
- $135,803 to $251,600 USD / year
Rockwell Collins Inc. has an opening for a Senior Principal Engineer, Software Engineering in Cedar Rapids, IA. National travel up to one time per year.
Added 1 hour ago
LillyDirect Pharmacy Master Data Technical Lead
Lilly
Indianapolis, IN
8+ years of professional experience in data engineering or software engineering, including 3+ years as a tech lead, principal engineer, or senior individual contributor.
Added 1 hour ago
Principal CSV Engineer - Automation Engineering
Lilly
Indianapolis, IN · Lebanon, IN
This role will work as a member of the Automation Engineering Department at Eli Lilly, Foundry. The engineer will serve as a technical subject matter expert, providing automation support…
Added 1 hour ago
Systems Engineer 4 - RF Communications - Space AHT
Northrop Grumman
Huntsville, AL
This position is for a Sr Principal Systems Engineer - RF Communications to support the IFICS Data Terminal (IDT) product team on the Ground Based Mid-Course Defense (GMD) Weapon System…
Added 1 hour ago
Principal Engineer Systems - AHT
Northrop Grumman
Huntsville, AL
Northrop Grumman Defense Systems (NGDS) is seeking Principal Systems to join our team. The preferred candidate will be responsible for developing, analyzing, and managing systems…
Added 1 hour ago
Principal/ Sr Principal Mission Assurance Engineer
Northrop Grumman
Huntsville, AL
Northrop Grumman Defense Systems is seeking a Principal/Sr. Principal Mission Assurance Engineer to support the SLCM-N Program Quality & Mission Assurance Team in Huntsville, AL. This role…
Added 1 hour ago
Sentinel - Systems Engineer / Principal Systems Engineer
Northrop Grumman
Huntsville, AL
Northrop Grumman Defense has an opening for a Systems Engineer (level 2)/ Principal Systems Engineer (level 3) to support a Futures Program within the Command Systems Business Unit (BU)…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 8, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 8, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe prog To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3MDg3Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job