Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
G
Manufacturing Engineer
GPAC
Rolling Meadows, IL
- $90,000 to $105,000 USD / year
Manufacturing Engineer • Process Engineer • Industrial Engineer • Mechanical Engineer • Manufacturing Engineering • Wire Forms • Springs • Precision Metal Components • Tooling Design •…
Added 2 mins ago
G
Manufacturing Engineer
GPAC
Roselle, IL
- $90,000 to $105,000 USD / year
Manufacturing Engineer • Process Engineer • Industrial Engineer • Mechanical Engineer • Manufacturing Engineering • Wire Forms • Springs • Precision Metal Components • Tooling Design •…
Added 5 mins ago
Project Industrial Water Wastewater Process Engineer
Arcadis
Raleigh
Arcadis’ Industrial Water Treatment and Optimization (IWTO) team is seeking an experienced Industrial Water Wastewater Process Engineer with 7+ years of consulting engineering experience to…
Added 5 mins ago
Staff Water Engineer
Arcadis
East Windsor
We are searching for a Staff Water Engineer to support and grow our Water team in East Windsor, NJ. This candidate will use their expertise and technical knowledge to deliver design work…
Added 5 mins ago
Mechanical Engineer, Insource Manufacturing (Starlink)
SpaceX
Bastrop, TX
…high-volume production of Starlink products. As a Mechanical Engineer in this group, you will take end-to-end ownership of critical manufacturing equipment and material handling systems.…
Added 5 mins ago
G
Manufacturing Engineer
GPAC
Arlington Heights, IL
- $90,000 to $105,000 USD / year
Manufacturing Engineer • Process Engineer • Industrial Engineer • Mechanical Engineer • Manufacturing Engineering • Wire Forms • Springs • Precision Metal Components • Tooling Design •…
Added 6 mins ago
CB
Senior Data Engineer
Commercial Bank of California
United States
- $135,000 to $170,000 USD / year
The Senior Data Engineer is responsible for designing, building, and operating scalable, secure data platforms that power enterprise analytics, reporting, and advanced data use cases,…
Added 7 mins ago
G
Manufacturing Engineer
GPAC
Bensenville, IL
- $90,000 to $105,000 USD / year
Manufacturing Engineer • Process Engineer • Industrial Engineer • Mechanical Engineer • Manufacturing Engineering • Wire Forms • Springs • Precision Metal Components • Tooling Design •…
Added 13 mins ago
Platform Engineer (TS/SCI CI Poly)
Seamless Migration
Reston · Alexandria · Washington · Colorado Springs
Seamless Migration is seeking a career and customer-oriented Platform Engineer to join our team.
Added 16 mins ago
AC-DC Power Design Engineer
Apple
San Jose, CA
Apple is looking for an experienced AC-DC Adapter Design Engineer to develop the next generation of high-density offline power supplies for our portable products.
Added 16 mins ago
Data Protection Engineer
Koniag Government Services
Washington, DC
Koniag Technology Solutions, inc a Koniag Government Services company, is seeking a Data Protection Engineer with a Secret Security clearance to support KTS and our government customer in…
Added 16 mins ago
Network Engineer
Koniag Government Services
Washington, DC · Arlington, VA
Koniag IT Systems LLC, a Koniag Government Services company, is seeking a Network Engineer to support KITS and our government customer in Washington, DC. This position requires daily…
Added 16 mins ago
Data Protection Engineer (Lakewood, CO)
Koniag Government Services
Lakewood, CO
Koniag Technology Solutions, inc a Koniag Government Services company, is seeking a Data Protection Engineer with a Secret Security clearance to support KTS and our government customer in…
Added 16 mins ago
Hyperconverged Infrastructure Engineer
Koniag Government Services
Lakewood, CO
Koniag Technology Solutions, inc a Koniag Government Services company, is seeking a Hyperconverged Infrastructure Engineer with a Secret Security clearance to support KTS and our government…
Added 16 mins ago
Hyperconverged Infrastructure Engineer
Koniag Government Services
Washington, DC
…motivated, and customer-oriented Hyperconverged Infrastructure Engineer to join our team supporting an enterprise data center environment hosting 3,000+ virtual machines. The ideal…
Added 16 mins ago
Cloud Engineer Architect
Koniag Government Services
Washington, DC
Koniag Technology Solutions, Inc a Koniag Government Services company, is seeking a Cloud Engineer Architect with a Secret security clearance to support KTS and our government customer in…
Added 16 mins ago
Financial Operations Engineer
Koniag Government Services
Chantilly, VA
Koniag IT Systems, LLC a Koniag Government Services company, is seeking a Financial Operations Engineer to support KITS and our government customer. The position is Hybrid (remote and the…
Added 16 mins ago
Unified Communications Engineer
Koniag Government Services
Huntsville, AL
…Government Services company, is seeking a Unified Communications Engineer with a secret clearance to support our Army customer in Huntsville, Alabama. This position requires on-site…
Added 16 mins ago
Software Developer
Koniag Government Services
Huntsville, AL
KGS is currently seeking an accomplished Senior Full Stack Software Engineer/Developer to spearhead the engineering, enhancement, and architectural modernization of core Line of Business…
Added 16 mins ago
Principal Cloud Security Engineer
Koniag Government Services
Washington, DC
Koniag Technology Solutions, Inc a Koniag Government Services company, is seeking a Principal Cloud Security Engineer with a Secret security clearance to support KTS and our government…
Added 16 mins ago
Network Engineer T4
Koniag Government Services
Washington, DC
Koniag IT Systems, LLC a Koniag Government Services company, is seeking a Network Engineer T4 to support KITS and our government customer Washington, DC. This position requires the…
Added 16 mins ago
Senior Network Engineer T4
Koniag Government Services
Washington, DC
Koniag IT Systems, LLC a Koniag Government Services company, is seeking a Senior Network Engineer T4 to support KITS and our government customer Washington, DC. This position requires the…
Added 16 mins ago
AWS Certified Solutions Architect - Associate
Koniag Government Services
Nashville, TN
…Architect – Associate to support the design, implementation, and optimization of Amazon Web Services (AWS) cloud architecture solutions for our Call Center serving government clients. The…
Added 16 mins ago
AI Security Engineer - Mid
Koniag Government Services
Washington, DC
The AI Security Engineer (Mid) will serve as a key technical contributor within the program's AI security engineering function, working under the direction of the AI Security Engineer Lead…
Added 16 mins ago
Zscaler Integration Engineer - Mid
Koniag Government Services
Washington, DC
Koniag Operations Services, LLC, a Koniag Government Services company, is seeking an experienced Zscaler Integration Engineer (Mid) to support enterprise network security operations and IT…

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 22, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjc3MzY5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job