Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
Sales Engineer - OEM (Emerging Market)
Baker Hughes
Liberty, MO
A Sales Engineer - OEM assists in the effort to develop and maintain the highest possible sales of company products in order to meet and exceed overall company sales goals. The focus of an…
Added 1 min ago
Sales Engineer - OEM (Americas)
Baker Hughes
Liberty, MO
A Sales Engineer - OEM assists in the effort to develop and maintain the highest possible sales of company products in order to meet and exceed overall company sales goals. The focus of an…
Added 1 min ago
Senior Technical Marketing Engineer, Distributed Networking, Content Delivery & AI
Akamai Technologies, Inc.
Jefferson City, MO
Are you the engineer who would rather demonstrate a claim than assert it?
Added 1 min ago
Civil Engineer - Mid-Level
Sargent & Lundy
Clayton, MO
+ Successful completion of the Fundamentals of Engineering (FE) exam, and designation as an Engineer in Training.
Added 1 min ago
Senior Civil Engineer -- Energy & Industrial Group
Sargent & Lundy
Clayton, MO
…new plant design to plant betterment and upgrade services for operating facilities. We have designed…
Added 1 min ago
IG
Senior Network Engineer
Insight Global
San Jose, CA
- From $70 USD / hour
We are seeking an experienced Senior Network Engineer to design, implement, and maintain our enterprise network infrastructure. The ideal candidate will have extensive hands-on experience…
Added 2 mins ago
PN
Process Engineer
pladis North America, Inc
United States
- $116,000 to $154,000 USD / year
The Process Engineer is a hands-on technical role responsible for developing, scaling, and improving manufacturing processes across R&D and manufacturing. The role leads technical trials,…
Added 3 mins ago
YieldStar Module Production Engineer
ASML US, LP. (US20)
Wilton, CT
This position is for a production engineer with an innovative attitude.
Added 3 mins ago
Optical/Mechanical Yieldstar Production Engineer
ASML US, LP. (US20)
Wilton, CT
This position is for a production engineer with an innovative attitude.
Added 3 mins ago
Structures Test & Evaluation Instrumentation Engineer (Experienced or Senior)
The Boeing Company
Berkeley, MO
Boeing Test & Evaluation (BT&E) is seeking a Structures Test & Evaluation Instrumentation Engineer (Experienced or Senior) , with experience in Test Control Methods and Data Acquisition…
Added 3 mins ago
Mechanical Engineer - Nuclear (Multiple Locations)
Burns & McDonnell
Kansas City, MO
…experienced mechanical engineers to our Nuclear team focusing on both operating Nuclear Power Plants and new nuclear power projects, including Small Modular Reactors (SMRs), microreactors…
Added 3 mins ago
Michigan Bridge Group Manager
WSP
Detroit, MI · Lansing, MI
Engineer license required (multi-state preferred).
Added 3 mins ago
B&
Project Manager - Nuclear (Multiple Locations)
Burns & McDonnell
Kansas City, MO
- $140,000 to $350,000 USD / year
…experienced Project Managers to our Nuclear team focusing on both operating Nuclear Power Plants and new nuclear power projects, including Small Modular Reactors (SMRs), microreactors and…
Added 3 mins ago
Automation Engineer
Howmet Aerospace
Tucson, AZ
The Automation Engineer is responsible for designing, implementing, supporting, and optimizing automated manufacturing systems and production processes. This position has a dotted-line…
Added 4 mins ago
Senior Software Engineer - Kubernetes platform
Cloudflare
Austin, TX · Denver, CO · NY · San Francisco, CA · Washington, DC
As an engineer on the Kubernetes platform team, you'll be building the tools to help engineers deploy and operate the services that make Cloudflare work. Our mission is to provide a…
Added 4 mins ago
UG
Senior Software Engineer
UnitedHealth Group
Eden Prairie, MN
- $91,700 to $163,700 USD / year
As a Senior Software Engineer on the OCPN Cloud Platform Team, you will drive the architecture, technical design, development, delivery, and operationalization of cloud-native, resilient,…
Added 4 mins ago
Lead Instrument & Controls Engineer - Nuclear (Multiple Locations)
Burns & McDonnell
Kansas City, MO
…experienced I&C engineers to our Nuclear team focusing on both operating Nuclear Power Plants and new nuclear power projects, including Small Modular Reactors (SMRs), microreactors and…
Added 4 mins ago
Lead Structural Engineer - Nuclear (Multiple Locations)
Burns & McDonnell
Kansas City, MO
…experienced structural engineers to our Nuclear team focusing on both operating Nuclear Power Plants and new nuclear power projects, including Small Modular Reactors (SMRs), microreactors…
Added 4 mins ago
A
Data Strategy & Governance Manager
Accenture
Saint Louis, MO
- $94,400 to $293,800 USD / year
…enterprises actually operate, where the friction lives, and how to engineer smarter solutions using AI and data to fundamentally transform business processes and…
Added 6 mins ago
Senior Software Engineer- User Behavior
Roblox
San Mateo, CA
5+ years of experience building and operating production backend systems at scale, ideally in Go or a comparable statically-typed backend language.
Added 6 mins ago
BA
Platform DevOps Engineer
Booz Allen Hamilton
Colorado Springs, CO
- $61,900 to $141,000 USD / year
…and delivery consistently and continuously. As a DevSecOps engineer at Booz Allen, you'll use the latest architectural approaches and open-source frameworks and resources to overcome your…
Added 8 mins ago
Senior Manager, Life Sciences Supply Chain & Operate
Deloitte
Kansas City, MO
…Senior Manager role sits at the intersection of client delivery, operating model transformation, and strategic capability building, with responsibility for leading complex engagements…
Added 8 mins ago
Senior Manager, Life Sciences Supply Chain & Operate
Deloitte
Saint Louis, MO
…Senior Manager role sits at the intersection of client delivery, operating model transformation, and strategic capability building, with responsibility for leading complex engagements…
Added 9 mins ago
Data Asset Model Senior Engineer
Mars Corporate
United States
…organizational change, we are seeking a FinTech Data Asset Model Senior Engineer to strengthen our capabilities in Azure Data Lake technologies within the FinTech Data Lake…
Added 11 mins ago
Sr. Cybersecurity Engineer
Gyrus ACMI, Inc.
Westborough, MA
…measures for new and existing products running Linux or Windows operating systems. Assist in proposing solutions and contributing to the technical direction for product security…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job