Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
S
Principal Software Engineer - Observability
Snowflake
Menlo Park, CA
- $264,000 to $379,500 USD / year
Snowflake’s AI Data Cloud supports critical enterprise workloads across multiple clouds and regions. As AI accelerates software development, the volume and pace of change are outgrowing…
Added 2 mins ago
Director - Customer Response Engineering
Trellix
Phoenix, AZ
The Director leads CRE globally and owns engineering response for strategic customers across our endpoint, data security, email, and network products. The role also owns prevention: finding…
Added 2 mins ago
Lead AI and Data Science Engineer II
Deloitte
Tempe, AZ
Do you have a strong background in machine learning and deep learning? Are you interested in utilizing your data science skills and leading a small team in a fast-paced environment to…
Added 2 mins ago
Confluent - Principal Engineer
IBM
TUCSON, AZ
Join us in building the next generation of Confluent Cloud, shaping how the world builds data systems. We help organizations put data in motion: capturing, transporting, and transforming it…
Added 2 mins ago
Confluent - Senior Product Manager I - Cloud Gross Margin & Global Expansion
IBM
TUCSON, AZ
…signals such as lost deals, pipeline, marketplace demand, and data residency requirements, and build ROI-based business cases for new region…
Added 2 mins ago
O
Associate Support Engineer
Oracle
Phoenix, AZ
- $21.3 to $45.05 USD / hour
-Follows standard procedures to identify and escalate issues to senior team members. Collects and reviews basic data and/or information to troubleshoot common errors.
Added 2 mins ago
O
Senior Core Infrastructure Engineer - Nashville, TN
Oracle
Phoenix, AZ
- $79,200 to $209,500 USD / year
…operability. Delivers features and load/performance tests; leverages data plane platforms and distributed state tools for high-volume retrieval, storage, and processing; and reviews peers’…
Added 3 mins ago
Senior Security GRC Engineer, AI & Automation
American Express Global Business Travel
Phoenix, AZ
AmexGBT’s Security GRC team is looking for a talented Senior Security GRC Engineer to design, build, and scale automation and AI-driven solutions that modernize our governance, risk, and…
Added 3 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Phoenix, AZ
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 3 mins ago
Partner Technical Lead - Insight
NetApp
Phoenix, AZ
NetApp is seeking a Partner Technical Lead (PTL, or otherwise known as a Partner/Channel Sales Engineer) aligned to Insight to strengthen partner technical expertise, expand engagement, and…
Added 3 mins ago
Data Platform Developer
Kimley-Horn
Phoenix, AZ
We are seeking a Data Engineer to join our growing Data & Analytics team. This role is responsible for designing, developing, and maintaining data pipelines and enterprise data solutions…
Added 3 mins ago
O
Senior Database Site Reliability Engineer – Oracle Database and GoldenGate (IC3)
Oracle
Phoenix, AZ
- $81,100 to $187,000 USD / year
Oracle Health Database Services is seeking a highly experienced, Site Reliability Engineer to lead database reliability engineering across mission-critical healthcare platforms.
Added 3 mins ago
Senior Lead Engineer
PwC
Phoenix, AZ
As a Senior Lead Engineer you will lead custom application development and testing efforts that help clients turn business needs into scalable software solutions across cloud-native and…
Added 3 mins ago
Senior Engineer
PwC
Phoenix, AZ
As a Senior Engineer you will help design, build, and test custom applications within our Advisory practice, bringing together software engineering, cloud-based solution delivery, and…
Added 3 mins ago
Network Operations Engineer
Meta
Phoenix, AZ
Meta is seeking a Network Operations Engineer to join our Edge and Network Services (ENS) Foundation NetOps team. In this role, you will utilize your knowledge in hyperscale data center…
Added 3 mins ago
Mechanical Engineer, Data Center Operations Engineering
Meta
Phoenix, AZ
Meta is seeking a Mechanical Engineer to join our Data Center Operations Engineering team. Our data centers are the foundation upon which our rapidly growing infrastructure efficiently…
Added 3 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Phoenix, AZ
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 3 mins ago
EG
QA Automation Engineer
Eliassen Group
Phoenix, AZ
- $75 to $82 USD / hour
Develop, document, and maintain functional test cases and test artifacts such as test data, data validation, and automated scripts.
Added 5 mins ago
TT
Mid/Senior Full Stack AI Engineer
True Talent Solutions Partners
San Francisco, CA
- $180,000 to $250,000 USD / year
- Address data residency and GDPR-related deployment requirements for customers in Europe.
Added 6 mins ago
Sr. Software Technical Support Manager
Jobgether
Remote, United States
Added 6 mins ago
J
Sr Cyber Engineer
Jobgether
Remote, United States
- $120,500 USD / year
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Cyber Engineer based in the United States.
Added 8 mins ago
Sr. Software Engineer, Data Engineering (X)
SpaceXSI
Palo Alto, CA
As a Data Engineer in X product engineering team, you will play a key role in providing comprehensive data solutions that own or serve a wide range of stakeholders, including our end-users…
Added 8 mins ago
Mechanical Engineer II or III
Integrated Production Systems, Inc
ARLINGTON, TX
We are seeking a Mechanical Engineer (II or III level) who can independently lead complex mechanical engineering work supporting commercial and U.S. Department of War (DoW) programs. This…
Added 15 mins ago
Distinguished Engineer - GaME (Geographies & Marketplace Experiences)
Nike
Beaverton, OR
We are seeking a world-class Distinguished Engineer to help define the future of Nike's global marketplace and digital consumer ecosystem.
Added 35 mins ago
Quality Systems Manager
Jobgether
Remote, United States
Relevant professional certification, such as ASQ Certified Quality Manager (CQM), Certified Quality Engineer (CQE), or equivalent.

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 22, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjc3MzY5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job