Jobs in the United States

25+ jobs

Save this search

Added just now
Senior AI Engineer
ModernaTX, Inc.
Cambridge, MA
Moderna is seeking a Senior AI Engineer to lead the design, development, and operation of AI applications for Supply Chain and enterprise Digital. This is a senior individual contributor…
Added 7 mins ago
Full Stack Engineer
True Talent Solutions Partners
San Francisco, CA
- Fix bugs and deliver product improvements for customer-facing, supplier-facing, and internal operations platforms.
Added 8 mins ago
Staff SRE, Site Experience
Reddit
Remote, United States
Experience with Kubernetes, containers, cloud infrastructure, and modern deployment platforms.
Added 8 mins ago
Senior SRE, Site Experience
Reddit
Remote, United States
Experience with Kubernetes, containers, cloud infrastructure, and modern deployment platforms.
Added 9 mins ago
Lead Data Engineer – Experimentation
INSPYR Solutions
Santa Monica, CA
Join the User Platforms organization as a Lead Data Engineer focused on Experimentation.
Added 25 mins ago
Sr. Technical Marketing Engineer
NetApp
Morrisville, NC
The CI Solutions team builds, validates, and launches NetApp data management, hybrid cloud, FlexPod, and next-generation AI infrastructure solutions. This role serves as a technical leader…
Added 25 mins ago
iOS Software Engineer - Creative Apps
Apple
Cary, NC
The Creativity Apps team is looking for an engineer with expertise in Apple platforms to help architect and build media management and collaboration features for creative tools. You’ll be…
Added 25 mins ago
IT Applications Engineer VI, Web, (Greensboro, NC)
Kaiser Permanente
Greensboro, NC
…practices, and technology modernization efforts across enterprise platforms. The role contributes to the delivery of cloud-based applications, APIs, microservices, content management…
Added 25 mins ago
Platform Engineer
ASM Research, An Accenture Federal Services Company
Raleigh, NC
The Platform Engineer (Ops Technology Lead) is responsible for designing, implementing, and maintaining IT infrastructure platforms within the CASTLE-NET program, ensuring reliability,…
Added 25 mins ago
Network Security Engineer Master
GovCIO
Raleigh, NC
The Senior Engineer will serve as a technical escalation point for complex network and security incidents, lead architecture and implementation initiatives, establish standards, and partner…
Added 25 mins ago
Senior Product Manager
Acxiom
Raleigh, NC
Experience implementing solutions with clean-room providers, cloud data platforms, or data collaboration partners.
Added 25 mins ago
Cybersecurity Engineer
Kimley-Horn
Raleigh, NC
Kimley-Horn, one of Fortune Magazine’s “100 Best Companies to Work For,” is seeking an experienced Cybersecurity Engineer to take technical ownership of key Security Operations…
Added 25 mins ago
C
Senior .NET Full Stack Engineer with C#
Cognizant
Raleigh, NC
- $86,000 to $99,000 USD / year
As a Senior .NET Full Stack Engineer with C#, you will make an impact by designing and developing scalable enterprise applications that support healthcare payer operations, including…
Added 25 mins ago
C
Senior Full Stack Engineer – .NET & C#
Cognizant
Raleigh, NC
- $86,000 to $99,000 USD / year
As a Senior Full Stack Engineer – .NET & C#, you will make an impact by designing and developing scalable enterprise applications that support healthcare payer operations, including…
Added 25 mins ago
Gemini Enterprise for CX Sr. Engineer
Accenture
Raleigh, NC · Charlotte, NC
A hands-on Senior Engineer with strong experience in Google’s Gemini Enterprise for Customer Experience (GECX) Solutions - now building deep expertise in Google Cloud Platform (GCP). You…
Added 25 mins ago
Data Privacy Delivery Lead
The Hartford
Charlotte, NC
Technical fluency across enterprise data environments, including relational databases, cloud data platforms, data war
Added 25 mins ago
AI Platform Engineer
Insight Global
Charlotte, NC
Insight Global is seeking an AI Platform Engineer with deep expertise in Kong Gateway Administration, API Management, and AI Gateway technologies for a leading enterprise technology client.…
Added 25 mins ago
Information Security Engineer Security Baseline Configuration
Wells Fargo
CHARLOTTE, NC
The engineer will contribute to the development, implementation, validation, and lifecycle management of security baselines that align with industry standards and enterprise security…
Added 25 mins ago
DevSecOps Engineer
BOOZ, ALLEN & HAMILTON, INC.
Fayetteville, NC
Modernizing digital infrastructure in classified environments demands engineers who can build secure enterprise platforms, operate them reliably, and elevate the teams that depend on them.…
Added 26 mins ago
Senior Power Management Engineer, Platforms Engineering
Google
Sunnyvale, CA
…computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of…
Added 26 mins ago
Staff Application Security Engineer
BambooHR
Remote, United States
…through open protocols. We're hiring a Staff Application Security Engineer to help lead application security through that shift and beyond. You'll set the review bar and standards for…
Added 28 mins ago
IT Systems Engineer
Lightning AI
San Francisco, CA · NY
Lightning AI is looking for an IT Systems Engineer to support our employees and help maintain and improve our internal IT systems. This hands-on role combines technical support, systems…
Added 31 mins ago
Principal Security Engineer
Cars.com LLC
Remote, United States
Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP), containerization technologies (e.g., Docker, Kubernetes), and infrastructure as code (IaC) tools.
Added 38 mins ago
Principal Software Engineer
The Mitre Corporation
McLean, VA
…enterprise data systems, software products, and enabling engineering platforms that support the CAASD FAA direct work program. We are a diverse, highly technical, and motivated team that…
Added 38 mins ago
Defensive Cybersecurity Engineer/Incident Response
The Mitre Corporation
McLean, VA · Bedford, MA · Colorado Springs, CO · Fort Meade - Annapolis Junction, MD · Huntsville, AL · San Diego, CA · Tampa, FL
Experience integrating AI-enabled workflows with cybersecurity platforms such as SIEM, SOAR, EDR/XDR, threat-intelligence, case-management, or cloud-security platforms.

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job