Jobs in the United States

25+ jobs

Save this search

Added 11 mins ago
O
Lead Principal Platform Software Engineer
Oracle
Nashville, TN
- $113,600 to $306,400 USD / year
We are seeking a Lead Principal Software Engineer to set long-term technical direction for the Robotics Automation Platform. You will lead architecture and technical delivery across…
Added 38 mins ago
USPACOM Group Lead
The MITRE Corporation
Honolulu, HI
…operational advantage through mission-driven analysis, C4I systems integration, and rapid concept development. From real-time support to live operations and joint exercises, to influencing…
Added 44 mins ago
SO
Transportation Planner 2 (40 Hour)
State of Connecticut
Newington, CT
- $91,979 to $132,381 USD / year
…NEC Commission initiatives. The role emphasizes multimodal integration, data-driven decision making, and alignment with the Department’s long-range strategic…
Added 46 mins ago
TL
Vice President, Data Systems
The Los Angeles Lakers, Inc
El Segundo, CA
- $275,000 to $300,000 USD / year
Position Summary: The Vice President, Data Systems will provide strategic and technical leadership for the organization’s data, software engineering, and technology infrastructure,…
Added 49 mins ago
Staff Software Engineer, Fullstack
QXO
Seattle, WA
As a Staff Software Engineer on the QXO RevX Pricing Technology team, you will lead the design, development, and operation of the systems that cost, price, and quote across QXO’s…
Added 1 hour ago
Manager Information Technology 3
Northrop Grumman
Linthicum Heights, MD
Northrop Grumman’s Chief Information and Digital Office (CIDO) is seeking an Information Technology Manager (M3) to lead the CIDO Engineering Digital Solutions organization in support of…
Added 1 hour ago
Senior Systems Engineer
CACI International
Fort Meade, MD
Join a team responsible for designing and delivering mission-critical systems that support national security objectives. As a Senior Systems Engineer, you will lead complex engineering…
Added 1 hour ago
Senior Hardware Engineer - Cross Domain Solutions (SME)
CACI International
Fort Meade, MD
Lead COTS and GOTS hardware integration efforts to support mission requirements.
Added 1 hour ago
Sentinel - Staff Systems Engineer - Lab Test Capability Lead
Northrop Grumman
Roy, UT · Roy
Northrop Grumman Defense Systems is seeking a Staff Systems Engineer - Lab Test Capability Lead to join the Sentinel Systems Engineering team located in Roy, UT. Northrop Grumman supports…
Added 1 hour ago
Staff Principal Systems Engineer 5
Northrop Grumman
Annapolis, MD
Northrop Grumman is seeking a Staff Principal Systems Engineer Level 5 to join our team of qualified, diverse individuals. The Marine Systems organization, part of Northrop Grumman Mission…
Added 1 hour ago
Lead Software Engineer - Java, Microservices, MuleSoft & API Development (Remote)
CareFirst
Baltimore, MD
The Lead Software Engineer provides technical leadership for the design, development, integration, testing, deployment, and support of enterprise-scale software solutions, APIs, and…
Added 1 hour ago
Senior Principal Optical Engineer
Northrop Grumman
Baltimore, MD
The EOIR team is seeking a Senior Principal Optical Engineer to serve as a technical lead for optical implementations and system development on advanced electro‑optical and infrared (EO/IR)…
Added 1 hour ago
Space Assembly Integration and Test (AI&T) IPT Lead - Staff Engineer Systems
Northrop Grumman
Baltimore, MD
The Assembly, Integration, and Test IPT (Integrated Product Team) Lead - Staff Engineer will oversee the AI&T process of space-based RADAR payloads which are comprised of an Electronically…
Added 1 hour ago
Security Engineer
BOOZ, ALLEN & HAMILTON, INC.
Annapolis Junction, MD
We need a technical professional responsible for designing, building, and maintaining systems that protect an organization's data, networks, and IT infrastructure from cyber-attacks. In…
Added 1 hour ago
Senior Platform Engineer
RTI International
UNAVAILABLE
As a Senior Platform Engineer, you will play a key role in building and advancing cloud-native platform capabilities, with a focus on Kubernetes, infrastructure automation, CI/CD,…
Added 1 hour ago
Senior Software Technical Program Manager
Muon Space
San Jose, CA
Founded in 2021, Muon Space is an end-to-end Space Systems Provider that designs, builds, and operates LEO satellite constellations delivering mission-critical data. Our revolutionary,…
Added 1 hour ago
Systems Engineer for Large Public Venues (East Coast)
Hewlett Packard Enterprise
All, NY · All, DE · All, GA · All, PA · Boston, MA · All, NC · All, OH · All, MD · All, FL
The Systems Engineer for Large Public Venues on the East Coast will be mainly responsible for providing technical support and leadership in the creation of deliverable Wi-Fi and wireless…
Added 1 hour ago
PM
Lead Forward Deployed Engineer
Prologis Management
Denver, CO
- $200,000 to $285,000 USD / year
Key responsibilitiesBuild deep fluency in an anchor domain and lead a portfolio of deployments spanning multiple workflows, business units or enterprise systems.
Added 1 hour ago
[US] Electronic Engineer
EdgeCortix
Remote, United States
EdgeCortix seeks to hire a talented and experienced Electronic Engineer to join our US based team and lead the design and development of our board level hardware products, including PCBAs…
Added 2 hours ago
IC
NM Wafer Packaging Manufacturing: Advanced Packaging Module Engineer
Intel Corporation
NM
- $76,390 to $146,440 USD / year
Lead efforts to resolve complex technical challenges and implement robust systems that prevent recurrence.
Added 2 hours ago
IC
NM Wafer Packaging Manufacturing Advanced Packaging Engineer
Intel Corporation
NM
- $103,730 to $198,820 USD / year
Lead efforts to resolve complex technical challenges and implement robust systems that prevent recurrence.
Added 2 hours ago
Sr. Staff Systems Integration & Test Engineer Lead – APG 81 / Airborne Radar
Northrop Grumman
Baltimore, MD
Northrop Grumman Mission Systems’ Baltimore and Partnered Sites (BaPs) division is seeking a Sr. Staff Systems Integration & Test (SI&T) Engineer Lead – APG‑81 / Airborne Radar in…
Added 2 hours ago
Senior Staff CORE Systems Engineer
Northrop Grumman
Baltimore, MD
As a senior member of the Foundational Systems Engineering Team, you will provide technical leadership to programs that transform concepts into fielded systems, driving cross discipline…
Added 2 hours ago
REMOTE Senior Amazon Connect Engineer
Insight Global
Baltimore, MD
Insight Global is seeking a Senior AWS Amazon Connect Engineer for a top power generation client. This individual will take ownership of the design, implementation, integration,…
Added 2 hours ago
Business Development & Field Innovation Manager
Motorola Solutions, Inc.
Remote, United States
Cross-Portfolio Integration: Drive joint solutioning and cross-development across the broader Motorola Solutions defense portfolio - integrating technologies from Silvus Technologies…

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 22, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjc3MzY5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job