Jobs in the United States

25+ jobs

Save this search

Added 46 mins ago
TT
Founding Forward Deployed Engineer
True Talent Solutions Partners
San Francisco, CA
- $180,000 to $230,000 USD / year
Join an early-stage AI customer success software team as a Founding Forward Deployed Engineer. You will work directly with enterprise customers to put AI agents into production, deliver…
Added 47 mins ago
K
Sr. Al Solution Engineer
Kentro
UNAVAILABLE
- $101,000 to $140,000 USD / year
Kentro is hiring for a Sr. AI Solution Engineer to support secure cloud data and applied AI initiatives for government customers. You will build governed data pipelines, automate cloud and…
Added 59 mins ago
Director of Growth Sales, Enterprise
Skai
los angeles, CA
…team. We're proud of our industry-leading digital marketing software but we're even prouder of the people behind it. That's where you come…
Added 1 hour ago
Senior Member of Technical Staff, Product Engineering
Pallet
NY · San Francisco, CA
We're hiring Product Engineers to bridge the gap between customers and our AI platform, customize solutions for enterprise clients, and collaborate with cross-functional teams to build our…
Added 1 hour ago
Senior Member of Technical Staff, Product Engineering
Pallet
San Francisco, CA · NY
We're hiring Product Engineers to bridge the gap between customers and our AI platform, customize solutions for enterprise clients, and collaborate with cross-functional teams to build our…
Added 1 hour ago
O
Principal Core Infrastructure Engineer
Oracle
Austin, TX
- $114,600 to $234,600 USD / year
Oracle Cloud Infrastructure (OCI) is hiring a Principal Core Infrastructure Engineer to join the Next Gen Network Observability team. Help build cloud-scale intelligence systems that enable…
Added 1 hour ago
O
Core Infrastructure Engineer 2
Oracle
Nashville, TN
- $70,000 to $166,100 USD / year
As a Core Infrastructure Software Engineer, you will:
Added 1 hour ago
A
Electrical Engineer
Actalent
Benton Harbor, MI
- $40 to $48 USD / hour
Job Title: Electrical EngineerJob DescriptionThis role involves the development of embedded software and firmware throughout the entire software development lifecycle. The engineer will be…
Added 1 hour ago
A
Electrical Engineer
Actalent
Saint Joseph, MI
- $35 to $45 USD / hour
Job Title: Electrical EngineerJob DescriptionThe Electrical Engineer plans and drives the seamless integration of SES modules and components within Advanced Development Projects (ADP) and…
Added 1 hour ago
TT
Software Engineer, AI Agents
True Talent Solutions Partners
Remote, United States
- $200,000 to $320,000 USD / year
- Experience building product software in a fast-moving startup or growth-stage environment, with increasing scope and responsibility.
Added 1 hour ago
Pre-Sales Solutions Engineer
Formance
New York, NY
- 3+ years of experience as a Solutions Engineer or Software Engineer.
Added 2 hours ago
Intern - Advanced Process Control (R2R)
Micron Technology
Boise
A Process Control Engineer Intern in Micron’s Technology Development team will participate in the development of process and equipment control solutions. In this position, you'll have the…
Added 2 hours ago
Principal Software Engineer - Simulation Data, Validation & Infrastructure
Irving, TX
…intelligent automation, and rigorous validation. This Principal Engineer role is a hands-on technical leadership position responsible for architecture, critical implementation, engineering…
Added 2 hours ago
Principal Software Engineer - Robotics & Physical AI Simulation
Irving, TX
This Principal Engineer role is a hands-on technical leadership position responsible for architecture, critical implementation, engineering standards, cross-team alignment, and mentoring.
Added 2 hours ago
Principal Software Engineer - Digital Twin and Simulation Platform
Irving, TX
This Principal Engineer role is a hands-on technical leadership position responsible for architecture, critical implementation, engineering standards, cross-team alignment, and mentoring.
Added 2 hours ago
Principal Software Engineer - Agentic AI & Simulation Automation
Irving, TX
This Principal Engineer role is a hands-on technical leadership position responsible for architecture, critical implementation, engineering standards, cross-team alignment, and mentoring.
Added 2 hours ago
Forward Deployed Solution Engineer – Applied AI FDE
ServiceNow
Remote, United States
You are a systems-minded, AI-native engineer who ships real software. You own the full stack - and are equally motivated by elegant APIs, intuitive UIs, and scalable orchestration…
Added 2 hours ago
Software engineer
SEI INVESTMENTS COMPANY
Oaks, PA
Added 2 hours ago
AI Data Scientist Intermediate
Geisinger System Services
Danville, PA
Added 2 hours ago
Systems Integration/Test Engineer Stf (Level IV)
Lockheed Martin
King of Prussia, PA
…searching for a motivated and passionate Mission Operations Support Engineer Lead to join our Ground Product Lines Mission Support Team in King of Prussia, PA or Boulder, CO . In this role,…
Added 2 hours ago
TA
Senior Software Engineer (Platform Engineering)-Remote, USA
Tempus AI, Inc.
Remote, United States
- $130,000 to $150,000 USD / year
The Senior Software Engineer is a hands-on technical leader responsible for architecting and delivering the Java-based services at the core of Ambry's platform modernization. This role…
Added 2 hours ago
Loftware Spectrum Technical Lead / Solution Engineer Loftware Spectrum Technical Lead /
NTT Data Americas, Inc.
Philadelphia, PA
NTT DATA's Client is currently seeking a Loftware Spectrum Technical Lead / Solution Engineer Loftware Spectrum Technical Lead / to join their team in Philadelphia, Pennsylvania (US-PA),…
Added 2 hours ago
Senior Business Analyst -Technical
Wolters Kluwer DXG U.S., Inc.
Coppell, TX
The Senior Technical Business Analyst – Product Engineering is responsible for translating business objectives into detailed, development-ready technical requirements while enabling modern…
Added 2 hours ago
Systems Engineer
Mind Robotics
Palo Alto, CA
We're looking for a Systems Engineer to own the requirements and architecture baseline for the robot - from decomposing high-level behaviors into measurable, traceable specs, to making sure…
Added 2 hours ago
Software Design Engineer Intern
DataRobot, Inc.
Boston, MA · Seattle, WA · San Francisco, CA
…- helping our documentation evolve seamlessly alongside our…

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Jan 1, 2027
Experience: 5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 13, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY0NTE2Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job