Jobs in the United States

25+ jobs

Save this search

Added just now
Senior React Native Developer
Concentrix
Frisco, TX
We’re looking for a senior, hands-on React Native Engineer to build and maintain high-impact mobile flows within the Client application. In this highly visible role, you will partner…
Added just now
Principal Software Development Engineer (AI Innovation)
CVS Health
Richardson, TX
The Principal Software Development Engineer will drive innovative, enterprise-wide solution designs at the business unit level for highly complex, strategic initiatives. In this high-impact…
Added just now
Senior Forward Deployed Engineer
Workday, Inc.
CA · GA
As a Senior Forward Deployed Engineer on the Developer Platform FDE team, you’ll bridge hands-on agent engineering with high-impact customer technical strategy. You’ll partner with…
Added just now
Forward Deployed Engineer
Workday, Inc.
CA · GA
As a Forward Deployed Engineer on the Developer Platform FDE team, you’ll combine hands-on agent engineering with direct customer work. Working alongside senior FDEs, you’ll help enterprise…
Added just now
Principal Forward Deployed Engineer
Workday, Inc.
CA · GA
As a Principal Forward Deployed Engineer on the Developer Platform FDE team, you’ll bridge hands-on agent engineering with high-impact customer technical strategy, taking on the most…
Added just now
Data Center Capacity Engineer
Meta
El Paso, TX
Meta is seeking a Data Center Capacity Engineer to help ensure our global data center infrastructure can meet the demands of billions of users across Meta's family of apps and services. In…
Added just now
T
MEP Quality Program Manager (Data Center Construction) - El Paso
TEKsystems
El Paso, TX
- $80 to $90 USD / hour
The QA/QC Program Engineer will support the site Quality Manager in leading and improving the construction quality program for a large, fast-paced hyperscale data center campus. This role…
Added 1 min ago
Network Engineer, Data Center Field Operations
Meta
El Paso, TX
Meta is looking for a Data Center Field Operations Network Engineer to support delivery of field services as part of our Edge and Network Services (ENS) team. The role requires subject…
Added 1 min ago
Lead Software Engineer (Full Stack)
U.S. Bank
Irving, TX
Added 1 min ago
A
Product Service Engineer
Actalent
Irving, TX
- $40 to $55 USD / hour
The Product Service Engineer supports an expanding portfolio of technology products by providing critical technical and application support to customers and dealers. This role focuses on…
Added 1 min ago
Senior Data Quality Engineer, Data Quality Services
Caterpillar, Inc.
Irving, TX
We are seeking a Senior Data Quality Engineer to define, measure, and automate the quality of the training and validation data used for robotics, autonomy, computer vision, and…
Added 1 min ago
Data Analytics Engineer
Citigroup
Irving, TX
The Data Analytics Engineer is a hands-on technical role within the Data Analytics team, responsible for designing, building, and optimizing scalable data pipelines, data transformation…
Added 1 min ago
Python Engineer with Gen AI
Kelly Services
Irving, TX
Our client, a leading energy company , is hiring a Python Developer in Irving, TX ! This is an onsite 3x a week.
Added 1 min ago
Lead Software Engineer-Java with Agentic AI
JPMorgan Chase
Plano, TX
As a Lead Software Engineer at JPMorganChase within the Consumer & Community Banking, you are an integral part of an agile team that works to enhance, build, and deliver trusted…
Added 1 min ago
Lead Software Engineer - Java with Agentic AI
JPMorgan Chase
Plano, TX
As a Lead Software Engineer at JPMorganChase within the Consumer & Community Banking, you are an integral part of an agile team that works to enhance, build, and deliver trusted…
Added 1 min ago
Software Engineer III - Performance and Resiliency Engineering
JPMorgan Chase
Plano, TX
As a Software Engineer III at JPMorganChase within the Consumer & Community Banking, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology…
Added 1 min ago
Senior DevOps Mobile Operations Engineer
ManpowerGroup
Plano, TX
Our client, Medical Device Software & Connected Systems is seeking a Senior DevOps Mobile Operations Engineer to join their team. As a Senior DevOps Mobile Operations Engineer, you will be…
Added 1 min ago
Lead Software Engineer, Front-End Engineering
Toyota
Plano, TX
…for millions of customers worldwide. We're looking for a Lead Engineer - an individual contributor who brings strong front-end expertise, solid full-stack instincts, and the technical…
Added 1 min ago
Infrastructure Engineer III
JPMorgan Chase
Plano, TX
As an Infrastructure Engineer III at JPMorganChase within the Corporate Sector – Infrastructure Platforms, you utilize strong knowledge of software, applications, and technical processes…
Added 1 min ago
Software Engineer (ICB 3)
Broadcom
Plano, TX
Broadcom’s Mainframe Software Division (MSD) is looking for a Software Engineer with a talent for developing software and contributing to a culture dedicated to quality, security, and a…
Added 1 min ago
Embedded SW Systems Architect
Analog Devices Inc.
NC · MA
Embedded / Software System Engineer within Datacenter Infrastructure
Added 1 min ago
Lead Systems Engineering / Architect
General Dynamics Information Technology
San Antonio, TX
This is the authoritative technical architecture lead for the entire hybrid enterprise. The Lead Systems Engineer shall design, govern, and maintain the hybrid enterprise architecture,…
Added 1 min ago
Lead Test and Evaluation Engineer (Onsite)
General Dynamics Information Technology
San Antonio, TX
The Test Engineer, in conjunction with the Government, develops, governs, and enforces an overarching Enterprise Test Framework to standardize testing methodologies and quality assurance…
Added 1 min ago
Instructional Designer I or II
Texas A&M Engineering
College Station, TX
Added 1 min ago
Platform Software Engineer - Intermediate level
USAA
San Antonio, TX · Plano, TX
…community and their families. As an Intermediate level Software Engineer on our Containers as a Service (CaaS) team, you'll contribute to the platform that powers thousands of applications…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Jan 1, 2027
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 13, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe prog To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjU3NjMxLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job