Jobs in the United States

25+ jobs

Save this search

Added just now
Principal Software Engineer
DriveTime
Tempe, AZ
In short, as a Principal Software Engineer, you will serve as a technical leader responsible for driving complex, business-critical initiatives across the organization. You will partner…
Added 1 min ago
Senior Vehicle Power Electronics Engineer
Anduril Industries
Santa Ana, CA · Costa Mesa, CA
You will own energy regulation for a maritime autonomous vehicle. Reporting to the Energy Systems Lead, you will design power conversion and regulation circuits that deliver stable, clean…
Added 1 min ago
Flight Test Engineer - Space Systems
Anduril Industries
Costa Mesa, CA
We are seeking a highly motivated and experienced Flight Test Engineer with a focus on developmental testing of a full range of Sub-sonic to Hypersonic systems. You will collaborate closely…
Added 8 mins ago
O
Lead Principal Software Engineer, Core Infrastructure
Oracle
Nashville, TN
- $146,300 to $306,400 USD / year
…Oracle's Cloud Infrastructure. You should be both a rock-solid lead developer, curious problem solver, a distributed systems generalist and/or skilled Linux engineer with Systems triage…
Added 8 mins ago
O
Lead Principal Platform Software Engineer
Oracle
Seattle, WA · Santa Clara, CA
- $113,600 to $306,400 USD / year
We are seeking a Lead Principal Platform Software Engineer to lead the architecture and delivery of critical platform systems and initiatives across teams. This is a hands-on technical…
Added 9 mins ago
Intern - Marketing Operations
Acxiom
Montpelier, VT
Participate in team meetings and contribute to discussions regarding campaign performance, process improvements, and best practices.
Added 9 mins ago
O
Commercial Technical Program Manager
Oracle
Montpelier, VT
- $126,200 to $264,100 USD / year
Lead complex escalation efforts by establishing clear ownership, identifying resolution paths, and maintaining transparent communication throughout execution.
Added 9 mins ago
O
Senior Database Site Reliability Engineer – Oracle Database and GoldenGate (IC3)
Oracle
Montpelier, VT
- $81,100 to $187,000 USD / year
Oracle Health Database Services is seeking a highly experienced, Site Reliability Engineer to lead database reliability engineering across mission-critical healthcare platforms.
Added 9 mins ago
Senior AWS Cloud Engineer
Serco
Montpelier, VT
Looking for a Senior Cloud Engineer opportunity in an environment where you can make an impact every day? Discover this great opportunity with the Center for Medicare and Medicaid Services…
Added 9 mins ago
Platform Engineer - Remote
SitusAMC
Montpelier, VT
Strong knowledge of Azure DevOps organizations, projects, repositories, pipelines, boards, artifacts, service connections, permissions, process templates, extensions, and integrations.
Added 9 mins ago
Software Engineer, Infrastructure - Central Growth
Meta
Montpelier, VT
Software Engineer, Infrastructure - Central Growth Responsibilities:
Added 10 mins ago
Senior Member of Technical Staff (SMTS) – Quantum Materials & Thin Films Engineering
Global Foundries
Essex Junction, VT
GlobalFoundries Quantum Technology Solutions (QTS) is seeking an experienced materials engineer to drive the development, characterization, and integration of advanced materials enabling…
Added 10 mins ago
Account Executive (Central)
Verint Systems, Inc.
Montpelier, VT
Responsible to lead all regularly scheduled calls and assign tasks with accountability to the virtual team members.
Added 10 mins ago
Advanced Lead Supplier Quality Engineer - Composites
GE Aerospace
Montpelier, VT
The Supplier Quality Engineer for Polymer Matrix Composites is an individual who can apply knowledge of RCCA and/or problem solving to lead supplier quality improvement of complex cross…
Added 10 mins ago
AI Automation Architect - Manufacturing and MES processes- Remote
Cognizant
Montpelier, VT
…admired companies in the world. Learn how Cognizant helps clients lead with digital at…
Added 11 mins ago
Project Manager
GPAC
Raleigh, NC
…located in the Raleigh market. They are looking for a Civil Engineer, with a passion to deliver excellence**!** This firm works hard to ensure that their projects are planned, designed &…
Added 13 mins ago
G
Construction Engineer / Project Manager, PE - MDOT
GPAC
Southgate, MI
- $105,000 to $145,000 USD / year
…engineering firm in Southeast Michigan, is seeking a Construction Engineer / Project Manager to lead MDOT and local agency construction…
Added 13 mins ago
H
Lead System Design Engineer
HighRes
Beverly, MA
- $100,000 to $120,000 USD / year
The Lead System Design Engineer (SDE) will be the technical expert for customer facing projects post purchase order. They will be the gating resource for handing a project with finalized…
Added 16 mins ago
G
Construction Administration Engineer - Municipal Infrastructure
GPAC
White Lake, MI
- $75,000 to $100,000 USD / year
…southeast Michigan, is adding a Construction Administration Engineer. You'll be the client's eyes and ears from bid through closeout on municipal infrastructure projects such as roads,…
Added 20 mins ago
ZT
Quality Control Laboratory Technician, Support I
Zebra Technologies
Morris Plains, NJ
- $23 USD / hour
Monitor and report test status of various production runs to QC Manager, Manufacturing Manager, QC Supervisor, Technology, or Process Engineer.
Added 21 mins ago
Lead AI Engineer
Guardian Life
Holmdel, NJ
The employee serves as a Lead AI Engineer responsible for architecting, developing, deploying, and supporting enterprise-scale Agentic AI solutions.
Added 21 mins ago
Intern - Marketing Operations
Acxiom
Trenton, NJ
Participate in team meetings and contribute to discussions regarding campaign performance, process improvements, and best practices.
Added 22 mins ago
Senior Industrial Engineer
Garmin International, Inc.
Olathe, KS
We are seeking a full-time Senior Industrial Engineer at Garmin's U.S. headquarters in the Greater Kansas City area. In this role, you will be responsible for providing technical leadership…
Added 30 mins ago
Senior Machine Learning Engineer I
Etsy, Inc.
Remote, United States
Etsy is hiring a Senior Machine Learning Engineer to join the Inventory team. Our team develops custom machine-learning models that can drive product vision and customer impact. We’re a…
Added 32 mins ago
SR MANUFACTURING STAMPING ENGINEER
TE Connectivity
GREENSBORO, NC
The Senior Manufacturing Engineer – Stamping provides hands-on technical leadership for stamping processes, progressive die performance, new product introduction, and continuous…

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 22, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjc3MzY5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job