Jobs in the United States

25+ jobs

Save this search

Added 8 mins ago
C
Sr. Building Engineer
CBRE
Columbus, OH
- $75,000 to $105,000 USD / year
…general direction, monitors building system operations and performance. Has critical, specialized knowledge required at client…
Added 8 mins ago
Process Engineer with Project Management Specialty
ManpowerGroup
Miamisburg, OH
…Manufacturing, and Specialty Chemicals , is seeking a Process Engineer with Project Management Specialty to join their team. As a Process Engineer , you will be part of the Engineering…
Added 8 mins ago
Zero Trust Architecture (ZTA)
Trinzic
Beavercreek Township, OH
We are seeking an experienced Zero Trust Architecture (ZTA) Architect/Engineer that will support the design, development, implementation, and continuous improvement of Zero Trust…
Added 8 mins ago
Principal Communication/Navigation Engineer ISR/SOF WIU.009
Credence Management Solutions LLC
Wpafb, OH
…an immediate need for a Principal Communication/Navigation Engineer, supporting the Fixed Wing Modification Branch AFLCMC/WIU at Wright Patterson AFB, OH. This program focuses on…
Added 8 mins ago
Research & Development Electrical Engineer
Trinzic
Beavercreek Township, OH
Innovative Projects: KBR’s work is at the forefront of engineering, logistics, operations, science, program management, mission IT and cybersecurity solutions.
Added 8 mins ago
Mechanical Engineer - Heat and CBRN
Hunter Defense Technologies Inc
Geneva, OH
…industrial customers, is looking for a dynamic, hands-on Mechanical Engineer in Geneva, OH. This engineer will develop heater systems and Chemical, Biological, Radiological Nuclear (CBRN)…
Added 9 mins ago
Space Electronics Packaging and Mechanical Product Design and Analysis Engineer (Associate)
The Boeing Company
El Segundo, CA
…Electronics Packaging and Mechanical Product Design and Analysis Engineer (Level 2) to join us as part of our Electronics Packaging and Mechanical Product Design Team located in El Segundo,…
Added 9 mins ago
Space Electronics Packaging and Mechanical Product Design and Analysis Engineer (Subject Matter Expert)
The Boeing Company
El Segundo, CA
…Electronics Packaging and Mechanical Product Design and Analysis Engineer (Level 4) to join us as part of our Electronics Packaging and Mechanical Product Design Team located in El Segundo,…
Added 9 mins ago
Space Electronics Packaging and Mechanical Product Design and Analysis Engineer (Associate or Mid-level)
The Boeing Company
El Segundo, CA
…Electronics Packaging and Mechanical Product Design and Analysis Engineer (Level 2 or 3) to join us as part of our Electronics Packaging and Mechanical Product Design Team located in El…
Added 9 mins ago
Software Lead Engineer
GE Aerospace
Evendale, OH
The Software Lead Engineer is the technical lead for embedded engine control software. You'll own the design of highly complex modules, critical components, or a whole software product, and…
Added 9 mins ago
Lead Rotor Mechanical Design Engineer
GE Aerospace
Evendale, OH
…integration, and support of future military engine products. The Lead Engineer will own the design & development of advanced military products components. The engineer will be responsible…
Added 9 mins ago
Product Engineer I
PARKER HANNIFIN CORPORATION
Ravenna, OH
…and Quality. Perform design responsibilities as assigned by Management with minimal supervision. PLEASE NOTE: This role is not eligible for Company provided relocation assistance or work…
Added 9 mins ago
Associate Gear Engineer
Dana Automotive Sytems Group LLC
Maumee, OH
Added 9 mins ago
Senior Remote Services Engineer
Honeywell Technologies
Independence, OH
As a Senior Remote Services Engineer here at Honeywell, you will play a critical role in delivering expert remote technical support and services to our customers. You will leverage your…
Added 9 mins ago
Senior Program Specialist
Honeywell Technologies
Independence, OH
Ensure system installation and performance meet customer and Honeywell quality standards.
Added 9 mins ago
Data Engineer
Trinzic
Beavercreek, OH
As a Data Engineer, you will have the opportunity to work with unstructured and structured data, develop databases, build data pipelines, and find innovative solutions to complex data…
Added 9 mins ago
Process Engineer - Machining
Component Repair Technologies
Mentor, OH
This role requires a strong technical background along with project management experience with a continuous improvement mindset. The Process Engineer must be able to work independently and…
Added 9 mins ago
Infrastructure Engineer - Intermediate - Columbus , OH
Innova Solutions Inc
Westerville, OH
Added 10 mins ago
Manufacturing Engineering Staff
GENERAL DYNAMICS LAND SYSTEMS INC
Lima, OH
Added 10 mins ago
Senior Mainframe z/OS Engineer (Remote/ Work from Home)
First National Bank of Omaha
Darbydale, OH
…organization's success. Summary of the Job: The Mainframe Senior Engineer Position is part of a managed services engineering team. The Mainframe Senior Engineer is responsible for…
Added 10 mins ago
Senior Mechanical Engineer
S2 HR SOLUTIONS 1D, LLC
Darbydale, OH
…The Opportunity.... We are seeking an experienced Mechanical Engineer to develop and improve mechanical parts and assemblies for airfield lighting products used in demanding airport…
Added 10 mins ago
PC
Branch Safety Engineer
PERFORMANCE CONTRACTING, INC.
Darbydale, OH
- $69,000 to $91,200 USD / year
…sets so you can fully realize your potential. Job Description Performance Contracting is seeking a Branch Safety Engineer for its PCI Columbus 582 operations based in Dublin, OH.…
Added 10 mins ago
Software Engineer III
PARKER HANNIFIN CORPORATION
Akron, OH
Position Summary Employer: Meggitt Aircraft Braking Systems Corporation Job Title: Engineer 3- Verification Job Location: 1204 Massillon Road, Akron, OH 44306 SCHEDULE: 40 hours per week,…
Added 10 mins ago
Substation Engineering
FirstEnergy
Akron, OH
The job of Substation Design Engineer requires an individual to be self-directed with an interest and / or ability to create and manage engineering designs, equipment and standards for the…
Added 10 mins ago
Industrial Engineer
Dana Automotive Sytems Group LLC
Toledo, OH

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job