Jobs in the United States

25+ jobs

Save this search

Added 7 mins ago
CNC Setup Operator
Danfoss
Van Wert, OH
Set up and operate multiple CNC lathes in accordance with production specifications. Monitor machine operations to identify any malfunctions or errors promptly.
Added 9 mins ago
Senior Controls & SCADA Engineer - Data Centers Job Details | Black & Veatch Family of Companies
Black & Veatch
Greenwood Village, CO
Serves as the technical specialist in a broad area of specialization, or in a narrow but specialized field. Develops and applies advanced engineering concepts and approaches to unique…
Added 9 mins ago
Controls & SCADA Engineer - Data Centers Job Details | Black & Veatch Family of Companies
Black & Veatch
Greenwood Village, CO
Serves as the technical specialist in a broad area of specialization, or in a narrow but specialized field. Develops and applies advanced engineering concepts and approaches to unique…
Added 28 mins ago
G
Machine Operator - Maintenance Training Opportunity!
GPAC
Reedsburg, WI
- $20 to $25 USD / hour
Collaborate with production and maintenance teams to support daily operations.
Added 33 mins ago
Production Operator III - Extruder Operator - 3rd Shift
United Petfood Producers USA Inc.
Decatur, AR
The Production Operator III – Extruder Operator is responsible for setting up, operating, monitoring, adjusting, and disassembling extrusion and related processing equipment to ensure the…
Added 39 mins ago
Furnace Engineer
Nuclear Fuel Services
Mt Vernon, IN
…Your responsibilities will include providing daily engineering support and ensuring compliance with contract requirements and technical procedures through training, process audits, process…
Added 39 mins ago
Furnace Engineer
BWX Technologies, Inc.
Mt Vernon, IN
…Your responsibilities will include providing daily engineering support and ensuring compliance with contract requirements and technical procedures through training, process audits, process…
Added 39 mins ago
RS
Forklift Operator Warehouse NEW PAY
Ryder System
Whitestown, IN
- $21 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production
Added 39 mins ago
RS
Warehouse Forklift Material Handlers
Ryder System
Frankfort, IN
- $21 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production
Added 39 mins ago
RS
Warehouse Forklift Operator
Ryder System
Frankfort, IN
- $21 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production
Added 40 mins ago
RS
NEW PAY Warehouse Forklift Operator
Ryder System
Lebanon, IN
- $21 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production
Added 40 mins ago
RS
Warehouse Forklift Operator NEW PAY
Ryder System
Lafayette, IN
- $21 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production
Added 40 mins ago
RS
Warehouse Material Handler I
Ryder System
Indianapolis, IN
- $19 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production
Added 57 mins ago
M
CNC Operator
ManpowerGroup
Huntsville, AL
- $22 USD / hour
Our client, manufacturing and machining operations is seeking a CNC Operator to join their team. As a CNC Operator, you will be part of the production team supporting day-to-day machining…
Added 57 mins ago
RS
Forklift Operator Warehouse
Ryder System
Montgomery, AL
- $19 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production
Added 1 hour ago
A
CMT Field Technician 1
Atlas
Whittier, CA
- $45 to $55 USD / hour
…the test of time through accurate materials testing and field support. If you enjoy hands-on work and seeing tangible results of your efforts, this position puts you right in the…
Added 1 hour ago
G
CNC Programmer/Operator/Designer
GPAC
Dyersburg, TN
- $65,000 to $75,000 USD / year
Great Company that is expanding its machining and production capabilities and is seeking a CNC Operator and Programmer with design experience and a passion to grow. This person will help…
Added 1 hour ago
G
Coater Operator - Specialty Materials Manufacturing
GPAC
Kent, OH
- $20 to $27 USD / hour
Our client is a growing specialty materials manufacturer seeking a Coater Operator to join their production team. This position is ideal for a mechanically inclined individual who enjoys…
Added 1 hour ago
G
Coater Operator - Specialty Materials Manufacturing
GPAC
Rootstown, OH
- $20 to $27 USD / hour
Our client is a growing specialty materials manufacturer seeking a Coater Operator to join their production team. This position is ideal for a mechanically inclined individual who enjoys…
Added 1 hour ago
G
Coater Operator - Specialty Materials Manufacturing
GPAC
Mantua, OH
- $20 to $27 USD / hour
Our client is a growing specialty materials manufacturer seeking a Coater Operator to join their production team. This position is ideal for a mechanically inclined individual who enjoys…
Added 1 hour ago
G
Coater Operator - Specialty Materials Manufacturing
GPAC
Cuyahoga Falls, OH
- $20 to $27 USD / hour
Our client is a growing specialty materials manufacturer seeking a Coater Operator to join their production team. This position is ideal for a mechanically inclined individual who enjoys…
Added 1 hour ago
G
Coater Operator - Specialty Materials Manufacturing
GPAC
Akron, OH
- $20 to $27 USD / hour
Our client is a growing specialty materials manufacturer seeking a Coater Operator to join their production team. This position is ideal for a mechanically inclined individual who enjoys…
Added 1 hour ago
G
CNC Programmer/Operator/Designer
GPAC
Paris, TN
- $65,000 to $75,000 USD / year
Great Company that is expanding its machining and production capabilities and is seeking a CNC Operator and Programmer with design experience and a passion to grow. This person will help…
Added 1 hour ago
Warehouse Supervisor, BlueOval Battery Park Michigan
Ford Motor Company
Marshall, MI
…accurately recorded and stored, orders are picked and staged, and production lines or outbound docks receive materials on time and without…
Added 1 hour ago
RS
Forklift Operator Warehouse Material Handler
Ryder System
LANSING, MI
- $18.72 to $19.15 USD / hour
Provide technical and maintenance support for different aspects related to the automated packing system during the core shift hour of production

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 8, 2026
Experience: 5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 8, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

5+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjA0MzE5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job