Jobs in the United States

25+ jobs

Save this search

Added just now
IG
Program Business Manager - Secret
Insight Global
Mojave, CA
- $150,000 USD / year
Verify (check and balance system) that the technical requirements of the contract are being fulfilled, and if not discuss with the Project Engineer and Management as required
Added 1 min ago
UG
Principal Data Engineering - Remote
UnitedHealth Group
Minnetonka, MN
- $112,700 to $193,200 USD / year
The Principal Data Engineer is a senior individual contributor responsible for designing, building, and scaling enterprise data platforms and data pipelines. This role combines cloud-based…
Added 1 min ago
UG
Senior Software Engineer
UnitedHealth Group
Eden Prairie, MN
- $91,700 to $163,700 USD / year
As a Senior Software Engineer on the OCPN Cloud Platform Team, you will drive the architecture, technical design, development, delivery, and operationalization of cloud-native, resilient,…
Added 1 min ago
KI
Construction Manager/ Civil Resident Engineer
KBA INC.
Bellevue, WA
- $74,880 to $208,000 USD / year
…ownership plan. We support and further professional growth and development. We work hard, and we have…
Added 1 min ago
Spring Migration Engineer
NTT DATA Americas, Inc.
Austin
We are currently seeking a Spring Migration Engineer to join our team in Austin, Texas (US-TX), United States (US).
Added 3 mins ago
SO
IT System Administration - Senior/Specialist
State of Washington
Olympia, WA
- $8,522 to $11,460 USD / month
This DevOps Engineer reports to the DevOps Architect and provides technical guidance to other DevOps engineers, with a focus on Linux systems and automation. The position works closely with…
Added 5 mins ago
Software Engineer II - Argo Applications
Frost Bank
San Antonio, TX
…build new solutions from the ground up? If so, being a Software Engineer II at Frost could be the job for…
Added 5 mins ago
Product Support Engineer
Samsung Electronics America, Inc.
Plano, TX
Position Objective: The DA Product Support Engineer is responsible for managing New Product Introduction (NPI) product quality evaluations, post-launch field quality support, and service…
Added 6 mins ago
Telecommunications Engineer 4 - Tysons, VA
M.C. Dean, Inc
Tysons, VA
The engineer is the technical authority for inside plant (ISP) and outside plant (OSP) infrastructure on assigned task orders. This includes cabling, equipment, pathways, spaces, and…
Added 6 mins ago
Telecommunications Engineer 2 - San Antonio, TX
M.C. Dean, Inc
San Antonio, TX
The engineer helps track the technical requirements of assigned projects through the full lifecycle, assisting with solution development, resolving construction discrepancies, and…
Added 6 mins ago
Telecommunications Engineer 3 - Tysons, VA
M.C. Dean, Inc
Tysons, VA
The engineer oversees the technical requirements of assigned projects through the full lifecycle, assisting with solution development, resolving construction discrepancies, and contributing…
Added 6 mins ago
Telecommunications Engineer 2 - Tysons, VA
M.C. Dean, Inc
Tysons, VA
The engineer helps track the technical requirements of assigned projects through the full lifecycle, assisting with solution development, resolving construction discrepancies, and…
Added 6 mins ago
Senior Design Engineer (Engineer 5)
M.C. Dean, Inc
Tysons, VA
…M.C. Dean, we are committed to building the next generation of technical leaders in electrical, engineering, and cybersecurity…
Added 6 mins ago
Telecommunications Specialist 2 (Technical Specialist 2) - Tysons, VA
M.C. Dean, Inc
Tysons, VA
The specialist helps track the technical requirements of assigned projects through the full lifecycle, assisting with solution development, resolving construction discrepancies, and…
Added 6 mins ago
Senior Software Engineer, Ads Measurement
Roblox
San Mateo, CA
A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences…
Added 6 mins ago
Telecommunications Specialist 4 (Technical Specialist 4) - Tysons, VA
M.C. Dean, Inc
Tysons, VA
The specialist is the technical authority for inside plant (ISP) and outside plant (OSP) infrastructure on assigned task orders. This includes cabling, equipment, pathways, spaces, and…
Added 6 mins ago
Telecommunications Specialist 2 (Technical Specialist 2) - San Antonio, TX
M.C. Dean, Inc
San Antonio, TX
The specialist helps track the technical requirements of assigned projects through the full lifecycle, assisting with solution development, resolving construction discrepancies, and…
Added 6 mins ago
G
Manufacturing Engineer
GPAC
Rolling Meadows, IL
- $90,000 to $105,000 USD / year
Our client, a well-established precision manufacturer, is seeking a Manufacturing Engineer to support the design, development, and continuous improvement of manufacturing processes for wire…
Added 6 mins ago
G
Manufacturing Engineer
GPAC
Roselle, IL
- $90,000 to $105,000 USD / year
Our client, a well-established precision manufacturer, is seeking a Manufacturing Engineer to support the design, development, and continuous improvement of manufacturing processes for wire…
Added 7 mins ago
RTL Engineer – Physical AI Solutions
Altera
San Jose, CA
As an RTL Engineer, you will be responsible for designing, implementing, and verifying high-performance digital logic that powers AI and accelerated computing solutions. You will…
Added 9 mins ago
Project Industrial Water Wastewater Process Engineer
Arcadis
Raleigh
Receive technical mentoring and guidance from a senior process engineer
Added 9 mins ago
Project Director Transportation
Arcadis
Irvine
Provide strong leadership, direction, and technical guidance to multidisciplinary project teams, creating a collaborative, high-performing environment focused on quality and successful…
Added 9 mins ago
Senior Civil Engineer
Arcadis
Highlands Ranch · Phoenix · Salt Lake City
Arcadis is seeking a Senior Civil Engineer to join our team in one of the following areas: Denver, Colorado; Phoenix, Arizona; or Salt Lake City, Utah. This position will provide senior…
Added 9 mins ago
Staff Water Engineer
Arcadis
East Windsor
We are searching for a Staff Water Engineer to support and grow our Water team in East Windsor, NJ. This candidate will use their expertise and technical knowledge to deliver design work…
Added 9 mins ago
Lead Program Manager
Arcadis
Chicago
Identify program-wide risks, dependencies, and emerging issues and lead the development of practical solutions.

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Jan 1, 2027
Experience: 5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 13, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY0NTE2Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job