Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
Wet Process & Applications Engineer - Hillsboro
SCREEN SPE USA
Hillsboro, OR
SCREEN is seeking a highly motivated Wet Process and Applications Engineer to support integrated process development for logic and memory customers, from laboratory development through fab…
Added 2 mins ago
Software Engineer, Lead
The MITRE Corporation
Aberdeen, MD
Added 2 mins ago
G
Manufacturing Engineer
GPAC
Itasca, IL
- $90,000 to $105,000 USD / year
Manufacturing Engineer • Process Engineer • Industrial Engineer • Mechanical Engineer • Manufacturing Engineering • Wire Forms • Springs • Precision Metal Components • Tooling Design •…
Added 2 mins ago
G
Staff Software Engineer, Applied AI
GridUnity
Remote, United States
- $250,000 to $265,000 USD / year
…solutions that eliminate bottlenecks in the interconnection process and accelerate the transition to a more affordable, sustainable, and resilient energy…
Added 6 mins ago
Principal ASIC Engineer
Echodyne Corp
Kirkland, WA
Echodyne is seeking a Principal ASIC Engineer to join our fast-growing team.
Added 7 mins ago
IG
Program Business Manager - Secret
Insight Global
Mojave, CA
- $150,000 USD / year
Experience overseeing an entire Aircraft build process, and understanding of how to complete the project within cost and schedule
Added 8 mins ago
ITS Classroom Central Senior Engineer
Old Dominion University
Norfolk, VA
In support of the Commonwealth’s commitment to inclusion, we are encouraging individuals with disabilities to apply through the Commonwealth’s Alternative Hiring Process.
Added 8 mins ago
Mechanical Engineer - PM
Old Dominion University
Norfolk, VA
The mechanical engineer, a member of the Facilities Management Design & Construction Team, provides designs, analyses, project management and inspections and condition assessments. Duties…
Added 8 mins ago
CAPITAL PROJECT MANAGER
Old Dominion University
Norfolk, VA
Considerable knowledge of facility design and design process, cost estimating, building codes, construction documents, construction materials and methods. Excellent written and verbal…
Added 9 mins ago
Tech Consultant - Infrastructure Patch & Unix Engineer
NTT DATA Americas, Inc.
Jacksonville
We are currently seeking a Tech Consultant - Infrastructure Patch & Unix Engineer to join our team in Jacksonville, Florida (US-FL), United States (US).
Added 9 mins ago
Unix Engineer - Infrastructure Patch
NTT DATA Americas, Inc.
Jacksonville
We are currently seeking a Unix Engineer - Infrastructure Patch to join our team in Jacksonville, Florida (US-FL), United States (US).
Added 9 mins ago
Spring Migration Engineer
NTT DATA Americas, Inc.
Austin
We are currently seeking a Spring Migration Engineer to join our team in Austin, Texas (US-TX), United States (US).
Added 9 mins ago
RU
Field Engineer
Randstad USA
Mendota, IL
- $60,000 to $75,000 USD / year
…configuration, and maintenance of voice communication systems. The Field Engineer will utilize company toolsets and diagnostic techniques to ensure optimal performance of both network and…
Added 11 mins ago
SO
IT System Administration - Senior/Specialist
State of Washington
Olympia, WA
- $8,522 to $11,460 USD / month
As a DevOps Engineer, you will help DCYF modernize and improve how technology is delivered by creating automation that makes systems more reliable, secure, and efficient. You will support…
Added 11 mins ago
Staff ML Engineer - Embodied AI Scaling Foundations
General Motors LLC
Remote, United States
As a Staff AI/ML Engineer in the Embodied AI Data Foundations organization, you will be an individual contributor developing data-centric AI solutions that directly improve autonomous…
Added 12 mins ago
Product Support Engineer
Samsung Electronics America, Inc.
Plano, TX
Position Objective: The DA Product Support Engineer is responsible for managing New Product Introduction (NPI) product quality evaluations, post-launch field quality support, and service…
Added 12 mins ago
Product Support Senior Engineer
Samsung Electronics America, Inc.
Plano, TX
The DA Product Support Senior Engineer is responsible for leading all DA Product engineers and controls each product engineers’ tasks. This senior role ensures New Product Introduction…
Added 12 mins ago
Experienced Engineer, Process Integration Engineering (PIE)
Samsung Austin Semiconductor, LLC.
Austin, TX
…the fab, the PIE works closely with the owners of each unit process layer to define, validate, and implement Best Known Methods (BKM). Additionally, the PIE maintains a strong…
Added 12 mins ago
Experienced DC Test Engineer
Samsung Austin Semiconductor, LLC.
1530 FM 973 Taylor, TX
As a DC Test Engineer at Samsung Austin Semiconductor (Taylor site), the candidate will be working with state-of-the-art technologies and devices. He/She will be responsible for providing…
Added 13 mins ago
Telecommunications Engineer 4 - Tysons, VA
M.C. Dean, Inc
Tysons, VA
We are seeking a Telecommunications Engineer 4 to join our Security and Electronic Systems (SES) business Unit. As part of (SES) Strategic Business Unit you will be part of a team that…
Added 13 mins ago
Telecommunications Engineer 2 - San Antonio, TX
M.C. Dean, Inc
San Antonio, TX
We are seeking a Telecommunications Engineer 2 to join our Security and Electronic Systems (SES) business Unit. As part of (SES) Strategic Business Unit you will be part of a team that…
Added 13 mins ago
Telecommunications Engineer 3 - Tysons, VA
M.C. Dean, Inc
Tysons, VA
We are seeking a Telecommunications Engineer 3 to join our Security and Electronic Systems (SES) business Unit. As part of (SES) Strategic Business Unit you will be part of a team that…
Added 13 mins ago
Telecommunications Engineer 2 - Tysons, VA
M.C. Dean, Inc
Tysons, VA
We are seeking a Telecommunications Engineer 2 to join our Security and Electronic Systems (SES) business Unit. As part of (SES) Strategic Business Unit you will be part of a team that…
Added 13 mins ago
Senior Design Engineer (Engineer 5)
M.C. Dean, Inc
Tysons, VA
We are seeking a Senior Design Engineer to join our Security and Electronic Systems (SES) business Unit. As part of (SES) Strategic Business Unit you will be part of a team that designs,…
Added 13 mins ago
Telecommunications Specialist 2 (Technical Specialist 2) - Tysons, VA
M.C. Dean, Inc
Tysons, VA
Apply the M.C. Dean Quality Control process so that all engineering deliverables meet project requirements, are clear and constructible, and meet M.C. Dean engineering standards.

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Jan 1, 2027
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 13, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe prog To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjU3NjMxLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job