Jobs in the United States

25+ jobs

Save this search

Added just now
Vice President, Demand Generation (ALT: Revenue Marketing)
Backbase
Atlanta, GA
…across the banking frontline. Over 120 banks already run on our platform, but our next phase of growth requires a deliberate, hyper-targeted focus on winning the Global…
Added 4 mins ago
Mechanical Engineer
Motive
Remote, United States
…single system. Combined with industry leading AI, the Motive platform gives you complete visibility and control, and significantly reduces manual workloads by automating and simplifying…
Added 5 mins ago
CM
Senior Frontend Engineer (Analytics Product Lead)
Capital Markets Gateway
Seattle, WA · Chicago, IL
- $180,000 to $200,000 USD / year
…the world’s most prestigious financial institutions. The CMG platform is currently relied upon by 25 global investment banks and 135 asset managers representing $40 trillion in AUM. For…
Added 9 mins ago
Data Protection Security Engineer
Conagra Brands
Omaha, NE
Support the continued development of the data protection program, including documentation, platform improvements, metrics, reporting, runbooks, and user guidance.
Added 9 mins ago
Senior AI Engineer, Release Engineering
Intercontinental Exchange (ICE)
Omaha, NE
The Senior Engineer is a full-stack engineer with strong AI and large language model (LLM) expertise, embedded within the Release Engineering Development team. This team designs and…
Added 9 mins ago
Front End Web Applications Developer (Mid-Level) (5664)
SMX
Lincoln, NE
SMX is currently looking for a highly motivated Software Engineer - Front End Web Applications to contribute to the design, build, support, and implementation of the Budget and Spend (BAS)…
Added 9 mins ago
Front End Web Applications Developer (Junior) (5660)
SMX
Lincoln, NE
SMX is currently looking for a highly motivated Software Engineer - Front End Web Application s to contribute to the design, build, support, and implementation of the Budget and Spend (BAS)…
Added 9 mins ago
Senior Security GRC Engineer, AI & Automation
American Express Global Business Travel
Lincoln, NE
AmexGBT’s Security GRC team is looking for a talented Senior Security GRC Engineer to design, build, and scale automation and AI-driven solutions that modernize our governance, risk, and…
Added 9 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Lincoln, NE
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 9 mins ago
Associate Software Engineer
Highmark Health
Lincoln, NE
This job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. Responsible for…
Added 9 mins ago
Network Operations Engineer
Meta
Lincoln, NE
Meta is seeking a Network Operations Engineer to join our Edge and Network Services (ENS) Foundation NetOps team. In this role, you will utilize your knowledge in hyperscale data center…
Added 9 mins ago
Vice President, Cloud Platform Engineer
SitusAMC
Lincoln, NE
…Docker, Kubernetes, and familiar with Git development. The Engineer is expected to provide strategy and implement enterprise-scale automation for scalability, performance, security, and…
Added 9 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Lincoln, NE
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 14 mins ago
Front End Web Applications Developer (Mid-Level) (5664)
SMX
Charleston, WV
SMX is currently looking for a highly motivated Software Engineer - Front End Web Applications to contribute to the design, build, support, and implementation of the Budget and Spend (BAS)…
Added 14 mins ago
Front End Web Applications Developer (Junior) (5660)
SMX
Charleston, WV
SMX is currently looking for a highly motivated Software Engineer - Front End Web Application s to contribute to the design, build, support, and implementation of the Budget and Spend (BAS)…
Added 14 mins ago
Senior Security GRC Engineer, AI & Automation
American Express Global Business Travel
Charleston, WV
AmexGBT’s Security GRC team is looking for a talented Senior Security GRC Engineer to design, build, and scale automation and AI-driven solutions that modernize our governance, risk, and…
Added 14 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Charleston, WV
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 14 mins ago
Associate Software Engineer
Highmark Health
Charleston, WV
This job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. Responsible for…
Added 14 mins ago
Network Operations Engineer
Meta
Charleston, WV
Meta is seeking a Network Operations Engineer to join our Edge and Network Services (ENS) Foundation NetOps team. In this role, you will utilize your knowledge in hyperscale data center…
Added 14 mins ago
Vice President, Cloud Platform Engineer
SitusAMC
Charleston, WV
…Docker, Kubernetes, and familiar with Git development. The Engineer is expected to provide strategy and implement enterprise-scale automation for scalability, performance, security, and…
Added 14 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Charleston, WV
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 23 mins ago
LillyDirect Pharmacy Master Data Technical Lead
Lilly
Indianapolis, IN
…you will own the technical direction and delivery of the data platform that creates trusted, consented customer and partner profiles. You will set engineering standards, guide a team of…
Added 23 mins ago
LillyDirect Pharmacy DevOps Engineer
Lilly
Indianapolis, IN
Manage AWS services used by the platform (for example S3, Glue, Lambda, Step Functions, IAM, KMS, VPC, CloudWatch) with a focus on security and cost, including least-privilege IAM roles and…
Added 23 mins ago
LillyDirect Pharmacy Data Engineer
Lilly
Indianapolis, IN
We are seeking a highly motivated Data Engineer for our LillyDirect Pharmacy Covered Entity (LDPCE) Master Data team. This role involves designing, building, and maintaining robust and…
Added 23 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Indianapolis, IN
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Jan 1, 2027
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 13, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe prog To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjU3NjMxLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job