Jobs in the United States

25+ jobs

Save this search

Added just now
Integrated Product Team Lead
L3Harris
Orlando, FL
…verification, and production tasks. The IPT lead coordinates and drives execution of the IPT’s tasks and manages technical progress, risk, and schedule while ensuring product quality. This…
Added just now
EG
QA Automation Engineer
Eliassen Group
Tallahassee, FL
- $75 to $82 USD / hour
…role will contribute to requirement analysis, test planning, execution, and results reporting while collaborating across agile…
Added 1 min ago
L
Cybersecurity Systems Engineer II
Lyntris
San Diego, CA
- $115,000 to $145,000 USD / year
Support the planning, coordination, and execution of systems engineering activities throughout the system lifecycle, including requirements development, architecture, design, integration,…
Added 5 mins ago
Senior Flight Test Engineer - Space Systems
Anduril Industries
Costa Mesa, CA
We are seeking a highly motivated and experienced Flight Test Engineer with a focus on developmental testing of a full range of Sub-sonic to Hypersonic systems. You will collaborate closely…
Added 5 mins ago
Systems Engineer - Level 3 or 4 (AHT)
Northrop Grumman
Redondo Beach, CA · Redondo Beach
Northrop Grumman’s Space Systems Sector is seeking a Systems Engineer – Level 3 or 4 to join our team in Redondo Beach, CA. This role can be filled at either Level 3 Principal Systems…
Added 6 mins ago
Mission Manager / Systems Engineer II
Lodestar
Los Angeles, CA
At Lodestar, as a Mission Manager / Systems Engineer II, you will own the success of a defence space mission from concept through to flight. You will be the single point of accountability…
Added 12 mins ago
#24251 - Junior QA Engineer
QualityAI
Santa Clara, CA
We are looking for an experienced Graduate Engineer / Junior QA Engineer to join our growing team!
Added 25 mins ago
Quality Engineer III
Hoffman Enclosures, Inc.
Anoka, MN
Support prototype, engineering, pilot, and pre-production builds, analyzing defects and process performance to identify and eliminate potential failure modes before full production release.
Added 25 mins ago
H
Advanced Chemical Engineer- Fired Heaters
Honeywell
Rosemont, IL · Houston, TX
- $104,000 to $149,000 USD / year
Interface directly with customers, vendors and global project teams to support project execution
Added 25 mins ago
H
Advanced Mechanical Engineer - Heat Exchangers
Honeywell
Rosemont, IL · Houston, TX
- $114,000 to $163,000 USD / year
Contribute to internal design standards, calculation tools, and documentation to improve project execution efficiency
Added 32 mins ago
Flight Test Engineer - Space Systems
Anduril Industries
Costa Mesa, CA
We are seeking a highly motivated and experienced Flight Test Engineer with a focus on developmental testing of a full range of Sub-sonic to Hypersonic systems. You will collaborate closely…
Added 39 mins ago
O
Lead Principal Platform Software Engineer
Oracle
Seattle, WA · Santa Clara, CA
- $113,600 to $306,400 USD / year
We are seeking a Lead Principal Platform Software Engineer to lead the architecture and delivery of critical platform systems and initiatives across teams. This is a hands-on technical…
Added 44 mins ago
Mechatronics Engineer III
JPL/NASA
Pasadena, CA
You will be working as a Mechatronics Engineer within the Mechanical Engineering, Integration, and Test Section, which leads the design, analysis, development, integration, and test of…
Added 45 mins ago
H
Lead System Design Engineer
HighRes
Beverly, MA
- $100,000 to $120,000 USD / year
The Lead System Design Engineer (SDE) will be the technical expert for customer facing projects post purchase order. They will be the gating resource for handing a project with finalized…
Added 1 hour ago
SR MANUFACTURING STAMPING ENGINEER
TE Connectivity
GREENSBORO, NC
The Senior Manufacturing Engineer – Stamping provides hands-on technical leadership for stamping processes, progressive die performance, new product introduction, and continuous…
Added 1 hour ago
H
R&D Writing System Engineer
HP
Corvallis
- $93,400 to $143,800 USD / year
…HP’s industry leading print businesses. This Specialist-level engineer primarily supports the PageWide Industrial (PWI) business by leading R&D development and integration of ink and…
Added 1 hour ago
Principal Systems Engineer - FMS
Aerospace
United States
…project. We are on the lookout for a highly experienced Systems Engineer who is passionate about developing and defining software requirements that meet the evolving needs of our…
Added 1 hour ago
Maintenance Engineer (Engineer 1) - MSS Talent Development Program
Los Alamos National Laboratory
Los Alamos, NM
…a career path towards facilities management. Starting as an Engineer I within the Maintenance and Site Services (MSS) Division, you will be provided the opportunity to experience all…
Added 1 hour ago
R&D Engineer 4 (Welding Engineer)
Los Alamos National Laboratory
Los Alamos, NM
You will participate in manufacturing process development and execution for gas tungsten arc (GTA) welds, and other high energy density welding processes (laser and electron beam welding)…
Added 1 hour ago
Materials Science Post-Bachelor's Engineer
Los Alamos National Laboratory
Los Alamos, NM
The MST-8 Materials Scattering Team is seeking a post-bachelor's engineer to support in situ microstructural characterization using neutron and synchrotron X-ray sources. The successful…
Added 1 hour ago
Cleared Senior/Principal R&D Electrical Engineer - System Environmental Qualification Testing, Onsite
Sandia National Laboratories
Albuquerque, NM
We are seeking an R&D Electrical Engineer to join our team. This opening provides an excellent opportunity for a highly-motivated individual with a scientific or engineering background to…
Added 1 hour ago
Sr Mechanical Engineer
Leidos
Albuquerque, NM
Leidos Defense Systems is seeking a highly motivated Sr Mechanical Engineer who loves collaboration and being a part of something big, to join our team. This role drives the implementation…
Added 1 hour ago
Sr Electrical Engineer
Leidos
Albuquerque, NM
Leidos Defense Systems is seeking a highly motivated Sr Electrical Engineer who loves collaboration and being a part of something big, to join our team. This role drives the implementation…
Added 1 hour ago
W80-4 Weapon Systems Engineer - W80-4 Life Extension Program Team, Onsite
Sandia National Laboratories
Albuquerque, NM
We are seeking an experienced Weapon Systems Engineer (WSE) (R&D Systems Engineer) to join the W80-4 Life Extension Program. The WSE is a key interface between Product Realization Teams…
Added 1 hour ago
Sr Surety Engineer
Leidos
Albuquerque, NM
Leidos Defense Systems is seeking a highly motivated Sr Surety Engineer who loves collaboration and being a part of something big, to join our team. This role drives the implementation of…

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 22, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjc3MzY5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job