Jobs in the United States

25+ jobs

Save this search

Added just now
Senior Forward Deployed Engineer (FDE Lead
ewminds consulting Services
East Pittsburgh, PA
Lead a portfolio of forward-deployed engineering engagements across business and platform domains; define priorities, allocate resources, and ensure delivery of measurable outcomes within…
Added just now
Full Stack Engineer
ewminds consulting Services
Clairton, PA
· Lead end-to-end software delivery: requirements, design, development, testing, deployment, and post-release support across multiple applications and services
Added just now
Staff Software Engineer, Eligibility & Benefits
Parachute Health
Remote, United States
Parachute Health is transforming post-acute care as the leading digital ordering platform for medical equipment and supplies. We connect major health systems, health plans, and suppliers to…
Added 1 min ago
A
Senior Software Engineer, Data Activation & Products - Activision
Activision
Santa Monica, CA
- $102,800 to $190,204 USD / year
We are looking for a talented Senior Software Engineer to join the Data Activation & Products team! You will help set the software engineering standards for our team, build internal…
Added 7 mins ago
Staff Software Engineer - Engineering Systems, Continuous Integration
Snowflake Inc.
Bellevue, WA
…workflows across Snowflake's engineering organization. As a Staff Software Engineer on this team, you will help define the technical direction of critical CI infrastructure used by…
Added 12 mins ago
Senior Engineer, Mission Planning
Spaceflight Industries, Inc.
Seattle, WA
BlackSky is looking for a strong, self-starting and eager engineer to join our Mission Planning Engineering team. This integrated product team is working to develop and maintain optimized…
Added 12 mins ago
Staff Engineer, Flight Software
Spaceflight Industries, Inc.
Seattle, WA
Join the Satellite Embedded Software Group (ESG) as a Staff Flight Software Engineer. This is a hands-on individual contributor role that reports to the Senior Manager of Flight Software.…
Added 12 mins ago
W
(USA) Staff, Software Engineer
Walmart
BELLEVUE, WA
- $132,000 to $264,000 USD / year
The (USA) Staff, Software Engineer will lead the development and delivery of scalable platform capabilities, including infrastructure, tooling, and AI/ML frameworks. This role drives the…
Added 23 mins ago
Senior Software Engineer, Search Platform
NY · Frisco, TX · Eagan, MN
The AI Enabled Software Engineering (AIESE) team within Thomson Reuters is seeking Senior Software Engineers to build the core of that platform: the ingestion pipelines that turn content…
Added 23 mins ago
Staff Software Engineer, Search Control Plane
NY · Frisco, TX · Eagan, MN
The AI Enabled Software Engineering (AIESE) team is seeking a Staff Software Engineer for a highly impactful role at the foundation of the search platform. You will design and deliver a…
Added 23 mins ago
Staff Software Engineer, Search Retrieval Platform
NY · Eagan, MN
Advanced Content Engineering (ACE) is seeking a Staff Software Engineer to democratize retrieval at Thomson Reuters. You will build the platform capabilities that let any product team,…
Added 26 mins ago
Senior Software Engineer - Java Full Stack & AI
Mastercard
O'Fallon, MO
As a Senior Software Engineer, you will independently deliver complex solutions, influence technical design decisions, and help drive engineering excellence across the platform. This role…
Added 26 mins ago
Senior Software Engineer - Java Full Stack & AI
Mastercard
O'Fallon, MO
As a Senior Software Engineer, you will independently deliver complex solutions, influence technical design decisions, and help drive engineering excellence across the platform. This role…
Added 27 mins ago
A
Principal Software Engineer, AI Inference Cloud
ARM
Seattle, WA
- $262,700 to $355,400 USD / year
As a Principal Engineer on Arm's AI Inference Cloud team, you will shape the technical direction and develop highly available, scalable services for running AI inference workloads. You will…
Added 27 mins ago
A
Principal Software Engineer, AI Inference Runtime
ARM
Seattle, WA
- $262,700 to $355,400 USD / year
As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.
Added 27 mins ago
A
Staff Software Engineer, AI Inference Cloud
ARM
Seattle, WA
- $209,100 to $282,900 USD / year
As an engineer on Arm's AI Inference Cloud team, you will shape the technical direction and develop highly available, scalable services for running AI inference workloads. You will guide…
Added 27 mins ago
A
Staff Software Engineer, AI Inference Runtime
ARM
Seattle, WA
- $209,100 to $282,900 USD / year
As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.
Added 28 mins ago
Software Engineer, Cloud Infrastructure
Verkada
San Mateo, CA
You can look at all kinds of communities to see our platform’s impact in the world. It's the retailer that uses our agentic AI to deter theft before it happens. The warehouse that uses…
Added 28 mins ago
Senior Software Engineer - Cameras
Verkada
San Mateo, CA
You can look at all kinds of communities to see our platform’s impact in the world. It's the retailer that uses our agentic AI to deter theft before it happens. The warehouse that uses…
Added 35 mins ago
Senior Engineer - Embedded/Flight Software
Spaceflight Industries, Inc.
Seattle, WA
Join the Satellite Embedded Software Group (ESG) as a Senior Flight Software Engineer. This is a hands-on individual contributor role that reports to the Senior Manager of Flight Software.…
Added 36 mins ago
LD
Senior Software Implementation Engineer - Phase 1
Lumin Digital
Remote, United States
- $145,000 to $165,000 USD / year
The Senior Software Implementation Engineer plays a key role in the successful technical delivery of Lumin Digital’s digital banking platform. Acting as both a solutions engineer and…
Added 37 mins ago
Senior Software Engineer, Infrastructure
Spaceflight Industries, Inc.
Tukwila, WA
The Senior Software Infrastructure Engineer is a hands-on individual contributor role that reports to theManager, Software Test & Infrastructure. You'll be responsible for the end-to-end…
Added 37 mins ago
S
Staff / Senior Staff Test Automation Engineer
SciTec
Boulder, CO
- $102,000 to $157,000 USD / year
SciTec is seeking a Test Automation Engineer to design, build, and maintain a continuous deployment pipeline (Kubernetes manifests, Helm charts, ArgoCD, Ansible Playbooks) of an integrated…
Added 38 mins ago
Principal Systems Engineer - Space Vehicle
Spaceflight Industries, Inc.
Tukwila, WA
Systems Engineers at BlackSky are the glue that ensures that all the components, subsystems, parts, hardware, software come together to produce best-in-class spacecraft. BlackSky is seeking…
Added 49 mins ago
Senior Analytics Engineer
Mercer Advisors
Remote, United States
The Senior Analytics Engineer helps Mercer Advisors build a modern, trusted data foundation that wealth advisors, client service teams, and firm leaders can rely on. Reporting to the VP,…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job