Jobs in the United States

25+ jobs

Save this search

Added 18 mins ago
TT
Senior Data & Machine Learning Engineer
True Talent Solutions Partners
New York City, NY
- $200,000 to $300,000 USD / year
- Build retrieval, ranking, and re-ranking systems to match ads with recipients.
Added 20 mins ago
Model Engineer, Multimodal Understanding
SpaceXSI
Palo Alto, CA
Design, build, and optimize large-scale distributed systems for multimodal pre-training, post-training, inference, data processing, and tokenization at web/petabyte scale
Added 40 mins ago
Senior Cloud Platform and DevSecOps Engineer - TS/SCI with Polygraph
GD Information Technology, Inc.
United States
DevSecOps, Linux, Microsoft Azure, Microsoft Windows, Systems EngineeringCertifications:
Added 1 hour ago
O
Lead Principal Platform Software Engineer
Oracle
Nashville, TN
- $113,600 to $306,400 USD / year
We are seeking a Lead Principal Software Engineer to set long-term technical direction for the Robotics Automation Platform. You will lead architecture and technical delivery across…
Added 1 hour ago
TL
Vice President, Data Systems
The Los Angeles Lakers, Inc
El Segundo, CA
- $275,000 to $300,000 USD / year
Bachelor’s degree in computer science, Software Engineer, Data Science, Information Systems, or a related technical discipline required
Added 1 hour ago
Staff Software Engineer, Fullstack
QXO
Seattle, WA
As a Staff Software Engineer on the QXO RevX Pricing Technology team, you will lead the design, development, and operation of the systems that cost, price, and quote across QXO’s…
Added 2 hours ago
Senior AI Engineer, Banking Technology
Citibank, N.A.
United States
Citi’s Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for Investment, Corporate, and Commercial…
Added 2 hours ago
Manager Information Technology 3
Northrop Grumman
Linthicum Heights, MD
At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today, and for generations to come. Our…
Added 2 hours ago
Principal AI/ML Engineer - TS/SCI w/ Poly
Parsons Corporation
Baltimore, MD
Ready for a challenge that puts you at the center of AI innovation for cyber operations? Are you an experienced AI/ML engineer who thrives in a fast-paced environment, enjoys turning…
Added 2 hours ago
Security Engineer
BOOZ, ALLEN & HAMILTON, INC.
Annapolis Junction, MD
We need a technical professional responsible for designing, building, and maintaining systems that protect an organization's data, networks, and IT infrastructure from cyber-attacks. In…
Added 3 hours ago
AA
Product Manager, Incentives
Augeo Affinity Marketing, Inc.
St Paul, MN
- $125,000 to $152,000 USD / year
…evaluation, prompting, and system design without being an ML engineer…
Added 3 hours ago
Applied AI Engineer II
Blue Origin LLC
Seattle, WA
…to develop reusable, safe, and low-cost space vehicles and systems within a culture of safety, collaboration, and inclusion. Join our team of problem solvers as we add new chapters to the…
Added 3 hours ago
EG
Senior Infrastructure Engineer
Eliassen Group
Orlando, FL
- $84 to $86 USD / hour
Our client seeks a Senior Infrastructure Engineer to support and evolve cloud infrastructure powering analytics platforms, optimization engines, and machine learning workloads. The role…
Added 4 hours ago
O
Lead Principal Software Engineer, Core Infrastructure
Oracle
Nashville, TN
- $146,300 to $306,400 USD / year
…rock-solid lead developer, curious problem solver, a distributed systems generalist and/or skilled Linux engineer with Systems triage experience able to dive deep into any part of the stack…
Added 4 hours ago
WI
(USA) Principal, Software Engineer
Walmart Inc.
United States
- $143,000 to $286,000 USD / year
The (USA) Principal, Software Engineer leads the design and delivery of scalable platform capabilities, driving innovation in cloud-native architectures and AI/ML integration. This role…
Added 4 hours ago
WI
Software Engineer II | Bentonville, Arkansas
Walmart Inc.
United States
- $80,000 to $155,000 USD / year
As a Software Engineer II, you will deliver high-quality software solutions by collaborating with cross-functional teams to design, develop, and maintain scalable applications and services.…
Added 5 hours ago
Principal Engineer, Automation Engineering -Aseptic Filling SME
J&J Family of Companies
Wilson, NC
The Automation Engineer will serve as the subject matter expert (SME) for the integrated aseptic vial and syringe filling lines for Project Eagle in Wilson, North Carolina. This role…
Added 5 hours ago
Information Security Engineer – Global Security Infrastructure
Micron Technology
Boise
JR116695 Information Security Engineer – Global Security Infrastructure
Added 5 hours ago
Staff Engineer, Systems Performance
Micron Technology
Richardson
Deploy, performance tune, and test data center solutions using cutting-edge memory and storage. Execute systems level projects to better understand data center workloads and maximize the…
Added 5 hours ago
RC
Full Stack Engineering Intern - Summer 2027
Raft Company Website
McLean, VA
- $20 to $24 USD / hour
As a Software Engineer Raftern, you will contribute to both frontend and backend development for impactful applications, building user-friendly web pages and interfaces using modern…
Added 5 hours ago
Technical Project Manager
Autoscience
Menlo Park, CA
At Autoscience Institute, we create AI systems that autonomously conduct AI research. Recently, we announced the first AI agent to autonomously create peer-reviewed literature (ICLR 2025…
Added 5 hours ago
AI Solutions Engineer
Stratolaunch
Mojave, CA
The AI Solutions Engineer contributes to the development, integration, and operation of AI capabilities across Stratolaunch. The Enterprise Software Team integrates a mix of COTS and custom…
Added 5 hours ago
TT
Founding ML Research Engineer
True Talent Solutions Partners
San Francisco, CA
- $180,000 to $230,000 USD / year
…in field operations. You will own production vision-language systems end to end, from model orchestration and evaluation to deployment on real…
Added 5 hours ago
Staff ML Engineer - Embodied AI Scaling Foundations
General Motors LLC
Remote, United States
As a Staff AI/ML Engineer in the Embodied AI Data Foundations organization, you will be an individual contributor developing data-centric AI solutions that directly improve autonomous…
Added 5 hours ago
AL
Senior Data Engineer
Absentia Labs
San Francisco, CA · Boston, MA · New York City, NY · Seattle, WA · San Jose, CA · Austin, TX
- $125,000 to $160,000 USD / year
You are a data engineer who thinks in systems and interfaces, not just pipelines. You are comfortable owning poorly defined problems and converging on robust solutions through thoughtful…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job