Jobs in the United States

25+ jobs

Save this search

Added 10 mins ago
Software Engineer, Sensors and System Software (C++, Linux)
Avride
Austin, TX
We are seeking a Software Engineer responsible for integrating the diverse array of sensors and various embedded hardware into our software pipelines. In this critical role, you will be…
Added 22 mins ago
Computing Infrastructure Engineer, System Administrator Network Management & Virtualization Focus, Onsite
Sandia National Laboratories
Albuquerque, NM
We are seeking a motivated and skilled Computing Infrastructure Engineer (CIE) to join our High Security Operations IT Services team. This role supports the full lifecycle management of…
Added 24 mins ago
Automation & Controls Software Engineer
Enchanted Rock Management LLC
Houston, TX
The Automation & Controls Engineer develops, tests, deploys, and maintains control logic and software for ERock’s power generation and microgrid systems. The role focuses on PLC and RTAC…
Added 29 mins ago
Senior Software Engineer
Northrop Grumman
Newport News
Northrop Grumman is seeking a Sr Software Engineer for our GCCS-J program in Newport News, Va.
Added 29 mins ago
Information Systems Engineer Manager 2
Northrop Grumman
Beale AFB
Northrop Grumman Aeronautics Systems has an opening for an Information Systems Engineer Manager 2 to join our team of qualified, diverse individuals within our Aircraft Solutions…
Added 33 mins ago
IT Network Engineer Sr.
Ann & Robert H. Lurie Children's Hospital of Chicago
Streeterville, IL
The IT Network Engineer, Senior is primarily responsible for the design, implementation and support of enterprise network infrastructure utilized by Lurie Children’s Hospital. This includes…
Added 35 mins ago
TT
Software Engineer, C++ Systems
True Talent Solutions Partners
San Francisco, CA
- $250,000 to $325,000 USD / year
- Experience with areas such as compilers, networking protocols, kernels, infrastructure, Kubernetes, distributed systems, storage, or data ingestion.
Added 36 mins ago
Sr. Software Engineer, Kernels/CUDA (C++)
SpaceXSI
Palo Alto, CA
Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operation
Added 37 mins ago
M
Robotics Software Engineer, Teleoperation
Mecka
New York, NY
- $200,000 to $240,000 USD / year
- Work with a Teleop Platform Engineer on the end-to-end latency budget and on what we record, at what rate, in what format.
Added 38 mins ago
IT Controls Engineer
Corning Incorporated
Newton, NC
The IT Controls Engineer supports the design, implementation, and continuous improvement of manufacturing control systems and operational technology across both Trivium manufacturing…
Added 38 mins ago
Technical Support Engineer - Second Shift
NetApp
Morrisville, NC
…support of that mission, we are seeking a Technical Support Engineer with Cloud Hyperscaler experience. We are looking for eager individuals who love debugging and solving technical…
Added 39 mins ago
Software Engineer
Teledyne
Durham, NC
Teledyne Scientific Company is seeking an exceptional Software Engineer to support advanced research and development projects that require algorithm and software development for autonomy,…
Added 39 mins ago
N
Sr. Serviceability Engineer
Nutanix
Durham, NC
- $110,000 to $218,000 USD / year
As a Serviceability Engineer, you actively participate in the capacity of an Individual Contributor providing serviceability requirements and working closely with Product Managers and…
Added 39 mins ago
Mainframe Storage Engineer (Entry Level)
CGI Technologies and Solutions, Inc.
Durham, NC
CGI Federal is seeking a Mainframe Storage Engineer to support the Social Security Administration (SSA) in maintaining and enhancing its enterprise mainframe storage environment. The…
Added 39 mins ago
Field Applications Engineer
Broadcom
Raleigh, NC
Core Switching Group (CSG) Software Field Applications Engineer (FAE) will be supporting industry leading XGS-Tomahawk series of products in AI clusters for scale up, scale out, scale…
Added 39 mins ago
Principal Platform Engineer
Default Brand
Spanaway, WA
Ashley Digital is seeking a Principal Platform Engineer to own infrastructure, reliability, and delivery pipelines for our digital experience ecosystem - including our core ecommerce…
Added 39 mins ago
Substation Physical Engineer - (South)
Leidos
Charlotte, NC
We are looking for a Substation Physical Engineer to join our team. As an Career Substation Physical Engineer, candidates will have the opportunity to work on projects for electric…
Added 39 mins ago
Substation Protection and Controls Engineer - (South)
Leidos
Charlotte, NC
We are looking for a Substation Protection & Control Engineer to join our team in our Substation South Group. As a Protection & Control Engineer, candidates will have the opportunity to…
Added 39 mins ago
Mainframe Systems Engineer
Regions Bank
Charlotte, NC
At Regions, the Mainframe Systems Engineer installs and maintains mainframe operating systems ensuring the stability, performance and security of our mainframe environment while driving…
Added 39 mins ago
T
Arista Engineer
TEKsystems
Charlotte, NC
- $49.85 to $55 USD / hour
…degree in computer science / engineering and/or 3+ Years of Networking Experience Demonstrated skill with creating and/or updating technical design documentation used by engineering teams.…
Added 41 mins ago
Senior Product Quality Engineer
Anduril Industries
Ashville, OH
…cutting-edge autonomy, AI, computer vision, sensor fusion, and networking technology to the military in months, not…
Added 41 mins ago
Senior Product Quality Engineer
Anduril Industries
Ashville, OH
…cutting-edge autonomy, AI, computer vision, sensor fusion, and networking technology to the military in months, not…
Added 42 mins ago
Solution Engineer
Embedding VC
Mountain View, CA
…halls, and beyond. We're looking for a bold, driven Solution Engineer to join our core team full-time and help us deploy these systems on the world…
Added 43 mins ago
T
Desktop Support Technician
TEKsystems
Oklahoma City, OK
- $30 to $35 USD / hour
…be fluent in multiple IT disciplines such as computing and networking. Must possess a High School Diploma. Degree may be substituted with 6 additional years of related experience.Duties:…
Added 44 mins ago
Staff Engineer, Systems Performance
Micron Technology
Richardson
2\. Server system memory, storage hierarchy, processors, AI accelerators, networking, and memory.

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job