Jobs in the United States

25+ jobs

Save this search

Added 6 mins ago
Specialist, Software Engineer
L3Harris Technologies
Salt Lake City, UT
L3Harris is actively seeking a highly motivated and dynamic individual to join our team as a Software Engineer for the System Software Integration and Test Team. In this role, you will…
Added 18 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Cheyenne, WY
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 18 mins ago
EG
QA Automation Engineer
Eliassen Group
Cheyenne, WY
- $75 to $82 USD / hour
Our client seeks a QA professional to conduct functional testing, load testing, usability testing, continuous integration, and code reviews. The role will contribute to requirement…
Added 19 mins ago
HH
Senior Software Engineer, App Enablement
Hinge Health
San Francisco, CA
- $158,000 to $217,000 USD / year
Hinge Health’s mobile app reaches members through a production system spanning code integration, mobile builds, release candidates, app-store submission, and phased rollout. App Enablement…
Added 22 mins ago
M
Senior Technical Support Engineer
Microsoft
TX · NC · Irving, TX · Charlotte, NC · Irving · Charlotte
- $86,100 to $187,400 USD / year
…delivering customer success. As a Senior Technical Support Engineer, you will own, troubleshoot, and solve complex customer technical issues. This opportunity will allow you to accelerate…
Added 27 mins ago
Test Manager - Output/CCM/Document Management Systems
Jobgether
Remote, United States
The position may potentially be combined with a 50% Test Engineer assignment.
Added 29 mins ago
CI
Embedded Controls Verification Engineer
Cintal, Inc.
Chillicothe, IL
- $80,000 to $105,000 USD / year
Support CAN/J1939 communications, diagnostics, fault injection, and ECU integration testing.
Added 29 mins ago
CI
Autonomous Systems Validation Engineer (MineStar Command)
Cintal, Inc.
Tucson, AZ
- $90,000 to $104,000 USD / year
Support integration testing involving onboard machine systems, software applications, network infrastructure, and related technologies.
Added 29 mins ago
Data Engineer
Bigbear.ai
Washington
BigBear.ai is hiring a Data Engineer to join our Data Architecture & Engineering team supporting mission-critical outcomes. In this role, you’ll build scalable, secure, and reliable data…
Added 39 mins ago
Senior Product Manager, Product Systems
Agoda
Chicago, IL
Added 43 mins ago
Emerging Technology Integration Engineer
Trinzic
Beavercreek Township, OH
We are seeking an experienced Emerging Technology Integration Engineer that provides technical and engineering support for Government-led prototyping initiatives involving next-generation…
Added 43 mins ago
Lead Engineer
E-Technologies Group, LLC
Pisgah, OH
Lead Engineer # Lead Engineer Employer: E Tech Group Location: West Chester, OH Department: Central Reference: 1453 At E Tech Group{rel="noopener noreferrer" target="_blank"} , joining our…
Added 43 mins ago
Senior Automation Engineer
E-Technologies Group, LLC
Pisgah, OH
Senior Automation Engineer # Senior Automation Engineer Employer: E Tech Group Location: West Chester. OH Department: Central Reference: 1454 At E Tech Group{rel="noopener noreferrer"…
Added 43 mins ago
Principal Communication/Navigation Engineer ISR/SOF WIU.009
Credence Management Solutions LLC
Wpafb, OH
…an immediate need for a Principal Communication/Navigation Engineer, supporting the Fixed Wing Modification Branch AFLCMC/WIU at Wright Patterson AFB, OH. This program focuses on…
Added 43 mins ago
Space Electronics Packaging and Mechanical Product Design and Analysis Engineer (Associate)
The Boeing Company
El Segundo, CA
…Electronics Packaging and Mechanical Product Design and Analysis Engineer (Level 2) to join us as part of our Electronics Packaging and Mechanical Product Design Team located in El Segundo,…
Added 43 mins ago
Space Electronics Packaging and Mechanical Product Design and Analysis Engineer (Subject Matter Expert)
The Boeing Company
El Segundo, CA
…Electronics Packaging and Mechanical Product Design and Analysis Engineer (Level 4) to join us as part of our Electronics Packaging and Mechanical Product Design Team located in El Segundo,…
Added 43 mins ago
Space Electronics Packaging and Mechanical Product Design and Analysis Engineer (Associate or Mid-level)
The Boeing Company
El Segundo, CA
…Electronics Packaging and Mechanical Product Design and Analysis Engineer (Level 2 or 3) to join us as part of our Electronics Packaging and Mechanical Product Design Team located in El…
Added 43 mins ago
Edison Works Design Engineer - Externals Mechanical Design
GE Aerospace
Evendale, OH
Added 43 mins ago
Software Lead Engineer
GE Aerospace
Evendale, OH
The Software Lead Engineer is the technical lead for embedded engine control software. You'll own the design of highly complex modules, critical components, or a whole software product, and…
Added 43 mins ago
Lead Rotor Mechanical Design Engineer
GE Aerospace
Evendale, OH
The Cold Section Design organization is responsible for the design, analysis, integration, and support of future military engine products. The Lead Engineer will own the design &…
Added 43 mins ago
Senior Program Specialist
Honeywell Technologies
Independence, OH
Minimum of 3 years of experience as a Project Manager, Engineer, or Field Technician in the building automation industry.
Added 43 mins ago
Engineer 2-3, Resident - DTNA
BENDIX Commercial Vehicle Systems
Avon, OH
…national origin, disability, or status as a protected veteran. Engineer 2-3, Resident - DTNA LOCATION: Avon / Oregon (US-OR), United States | BRAND: Bendix | REQUISITION ID: 11856 | JOB…
Added 44 mins ago
Engineer: Motor Control - experienced (Aerospace)
PARKER HANNIFIN CORPORATION
Elyria, OH
…etc.). Essential Functions: Lead research, design, development, integration, and verification of high-reliability aerospace motor controller products, including brushless DC motor drive…
Added 44 mins ago
FMS Systems Engineer (Evergreen)
ODYSSEY SYSTEMS CONSULTING GROUP
Dayton, OH
FMS Systems Engineer (Evergreen) Job Locations US-OH-Dayton ID 2026-7799 Category Engineering Type Full Time Biweekly Hours 80 Location : Name Dayton OH Position Summary Evergreen…
Added 44 mins ago
Electrical/Avionics Systems Engineering Support - Journeyman
Oasis Systems, Inc.
Dayton, OH

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 8, 2026
Experience: 5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 8, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjA0MzE5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job