Jobs in the United States

25+ jobs

Save this search

Added 4 mins ago
#24251 - Junior QA Engineer
QualityAI
Santa Clara, CA
QualityAI is an AI-first quality engineering company helping enterprises deploy and scale complex systems with greater confidence. Operating across data, models, platforms, infrastructure,…
Added 7 mins ago
A
Senior IT Systems Administrator
AgelessRx
Remote, United States
- $155,000 to $180,000 USD / year
AgelessRx is seeking a hands-on, highly organized Senior IT Systems Administrator to own the day-to-day operation of our internal technology environment. As a fully remote telehealth…
Added 24 mins ago
Cloud Efficiency Engineer (AWS/FinOps)
Buildkite
United States
…on Buildkite to run builds, tests, and deployments on their infrastructure, ours, or both - giving them the speed, reliability, and flexibility to ship with…
Added 32 mins ago
O
Lead Principal Software Engineer, Core Infrastructure
Oracle
Nashville, TN
- $146,300 to $306,400 USD / year
As a Consulting Member of Technical Staff, you will own the software design and development for major components of Oracle's Cloud Infrastructure. You should be both a rock-solid lead…
Added 32 mins ago
O
Lead Principal Platform Software Engineer
Oracle
Seattle, WA · Santa Clara, CA
- $113,600 to $306,400 USD / year
We are seeking a Lead Principal Platform Software Engineer to lead the architecture and delivery of critical platform systems and initiatives across teams. This is a hands-on technical…
Added 39 mins ago
Tosca Test Automation Lead
QualityAI
Santa Clara, CA
QualityAI is an AI-first quality engineering company helping enterprises deploy and scale complex systems with greater confidence. Operating across data, models, platforms, infrastructure,…
Added 45 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Trenton, NJ
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 49 mins ago
WI
(USA) Principal, Software Engineer
Walmart Inc.
United States
- $143,000 to $286,000 USD / year
The (USA) Principal, Software Engineer leads the design and delivery of scalable platform capabilities, driving innovation in cloud-native architectures and AI/ML integration. This role…
Added 54 mins ago
Senior Software Engineer II
Samsara
Remote, United States
We are looking for a product-minded senior engineer who can own ambiguous problems end to end, make practical tradeoffs across surfaces, and ship work that holds up in the field. You will…
Added 1 hour ago
IT Controls Engineer
Corning Incorporated
Newton, NC
The IT Controls Engineer supports the design, implementation, and continuous improvement of manufacturing control systems and operational technology across both Trivium manufacturing…
Added 1 hour ago
Principal Engineer, Automation Engineering -Aseptic Filling SME
J&J Family of Companies
Wilson, NC
The Automation Engineer will serve as the subject matter expert (SME) for the integrated aseptic vial and syringe filling lines for Project Eagle in Wilson, North Carolina. This role…
Added 1 hour ago
Technical Support Engineer - Second Shift
NetApp
Morrisville, NC
Looking to join a fast paced and challenging technical team where you can put your Cloud Hyperscaler knowledge to use? NetApp is growing our Cloud teams across the US, Europe and APAC. In…
Added 1 hour ago
Information Security Engineer – Global Security Infrastructure
Micron Technology
Boise
JR116695 Information Security Engineer – Global Security Infrastructure
Added 1 hour ago
Staff Structural Engineer
Micron Technology
Boise
As a Structural Engineer, you will provide technical expertise throughout the design and construction lifecycle of major capital projects. You’ll work with design partners, contractors, and…
Added 1 hour ago
Senior Engineer, Chemical Systems
Micron Technology
Boise
As a Senior Engineer, Chemical Systems, you will provide technical leadership for chemical and wastewater systems across major construction projects. You will coordinate external…
Added 1 hour ago
Senior Engineer, Bulk Gas
Micron Technology
Boise
As Senior Engineer, Bulk Gas, you will be essential to our growth, guiding technical efforts for extensive gas production, storage, supply, and distribution systems that support significant…
Added 1 hour ago
Senior Engineer, Bulk Gas
Micron Technology
Boise
As a Senior Bulk Gas Build Engineer, you will provide technical leadership for large-scale gas production, storage, supply, and distribution systems supporting major semiconductor…
Added 1 hour ago
Senior Engineer, Specialty Gas Systems
Micron Technology
Boise
JR115583 Senior Engineer, Specialty Gas Systems
Added 1 hour ago
Lead Senior Cloud Platform Engineer
Stanley Martin Homes, LLC
Reston, VA
A day in the life of a Lead Senior Cloud Platform Engineer begins with partnering with application, data, AI, and infrastructure teams to ensure cloud platforms are enabling the secure,…
Added 1 hour ago
AI Solutions Engineer
Stratolaunch
Mojave, CA
This position will focus on the infrastructure, integrations, observability, and developer tools required to operationalize AI for vehicle design, manufacture, flight test, and business…
Added 1 hour ago
G
Staff Software Engineer, Applied AI
GridUnity
Remote, United States
- $250,000 to $265,000 USD / year
GridUnity is seeking a Staff Software Engineer to join our Platform team, reporting to the Director of Engineering, Applied AI. You will turn our customer workflow vision into reliable…
Added 1 hour ago
AL
Senior Data Engineer
Absentia Labs
San Francisco, CA · Boston, MA · New York City, NY · Seattle, WA · San Jose, CA · Austin, TX
- $125,000 to $160,000 USD / year
Absentia Labs is building the data and intelligence infrastructure that powers the next generation of biomedical discovery. We work at the intersection of biology, chemistry, machine…
Added 1 hour ago
CB
Senior Data Engineer
Commercial Bank of California
United States
- $135,000 to $170,000 USD / year
The Senior Data Engineer is responsible for designing, building, and operating scalable, secure data platforms that power enterprise analytics, reporting, and advanced data use cases,…
Added 2 hours ago
F
Staff Security Engineer
fal
San Francisco, CA
- $180,000 to $250,000 USD / year
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and…
Added 2 hours ago
Applications Support Sr Analyst
Citibank, N.A.
United States
The Observability Engineer will support the organization's observability transformation initiatives by helping onboard applications to modern observability platforms and OpenTelemetry…

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 22, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjc3MzY5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job