Jobs in the United States

25+ jobs

Save this search

Added 4 mins ago
Cloud Solution Engineer (Genomics & AI)
Oracle
Jefferson City, MO
The opportunity Oracle is seeking a senior pre-sales engineer with expertise in genomics, software engineering, and applied AI/ML. You will help molecular diagnostics companies, genomics…
Added 52 mins ago
Information Assurance Security Engineer - Top Secret
General Dynamics Information Technology
Arnold, MO
General Dynamics Information Systems (GDIT) is seeking a Security Engineer to provide expert technical services on all aspects of Information Security.
Added 1 hour ago
Staff Customer Engineer, Platform and Devices Enterprise Solutions
Google
San Jose, CA · Mountain View, CA · San Francisco, CA
As the Customer Engineer for Americas-West, you will support enterprise pre-sales opportunities and fuel business growth for Platform and Devices Enterprise Solutions. Your technical role…
Added 1 hour ago
A
Senior Cloud & Application Security Engineer
AXON-Networks
Irvine, CA
- $150,000 to $220,000 USD / year
This position is not intended to replace Engineering ownership of secure software and infrastructure. Instead, the Security Engineer provides security expertise, technical assurance,…
Added 1 hour ago
M
Software Engineer II & Senior Software Engineer - CoreAI Speech Team
Microsoft
WA · Redmond, WA · Redmond
- $102,100 to $202,200 USD / year
…You'll have the opportunity to help shape the architecture and technical direction of a new platform while growing your technical scope across data, cloud, speech, and AI…
Added 1 hour ago
M
Site Reliability Engineer II
Microsoft
WA · Redmond, WA · Redmond
- $102,100 to $219,200 USD / year
The Enterprise IAM Active Directory (AD) team engineers and operates secure, reliable, and resilient identity infrastructure supporting critical authentication services across Microsoft. We…
Added 1 hour ago
Sr. Software Integration Engineer
Ultima Genomics
Remote, United States
As a Senior Software Integration Engineer, you will design and build agents and automated solutions for software integration, testing, release and deployment processes, and will create an…
Added 1 hour ago
J
Full-Stack Platform Engineer
Jobgether
Remote, United States
- $190,000 to $215,000 USD / year
We are seeking an experienced Full-Stack Platform Engineer to provide technical leadership and hands-on engineering for a secure enterprise data analytics platform supporting federal…
Added 1 hour ago
J
Electrical/Controls Engineer II Energy
Jobgether
Remote, United States
- $79,600 to $132,700 USD / year
The Electrical/Controls Engineer II will contribute to the design, development, and implementation of electrical power and control systems for complex energy and industrial projects. Based…
Added 2 hours ago
M
Senior Software Engineer-Distributed System
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
We are hiring a Software Engineer to join the Azure Cosmos DB Gateway team, where you will work on the critical front-end data plane that powers one of the largest globally distributed…
Added 2 hours ago
M
Principal Software Engineer
Microsoft
WA · Redmond, WA · Redmond
- $142,800 to $304,200 USD / year
As a Principal Software Engineer in the Microsoft Dataverse team, you will define and drive the technical strategy for intelligent, globally distributed services that power Dataverse. You…
Added 2 hours ago
M
Senior Software Engineer - AI Experiences, Monetization
Microsoft
NY · WA · Redmond, WA · New York · Redmond
- $119,800 to $261,000 USD / year
The team is looking for a Senior Software Engineer to drive technical solutions that advance artificial intelligence capabilities and engineering practices across the software development…
Added 2 hours ago
M
Senior Security Software Engineer
Microsoft
United States
- $119,800 to $261,000 USD / year
…threats and strengthen the security of products, services, and AI systems. AI is increasingly important to that mission as capabilities and threat models evolve. Within MRT, the Microsoft…
Added 2 hours ago
M
Principal Software Engineer(s) + Senior Software Engineer(s)
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $234,700 USD / year
As a Senior Software Engineer, you will own significant services or components from design through production, make sound engineering trade-offs, and collaborate across teams to improve…
Added 2 hours ago
M
Software Engineer II
Microsoft
BC, CA
- $85,800 to $169,300 CAD / year
As a Software Engineer II on our team, you will design, develop, test, and maintain components of highly scalable and reliable cloud infrastructure. You will solve technical challenges…
Added 2 hours ago
Cybersecurity Engineer
SemiAnalysis
New York City, NY · San Francisco, CA · Chicago, IL
…fabrication processes to cutting-edge AI Models, software, and infrastructure. We are recognized as the leading authority on the semiconductor supply chain, with the highest concentration…
Added 2 hours ago
Hypersonic Wind Tunnel Lead Engineer
Jobgether
Remote, United States
We are seeking an experienced Hypersonic Wind Tunnel Lead Engineer to provide technical leadership and oversight for the development, integration, and operation of advanced aerospace test…
Added 2 hours ago
Project Engineer
Worley
BC, CA
…Document Control, Construction, customers and vendors, the Project Engineer helps ensure technical scope is clearly defined and delivered in accordance with project requirements, quality…
Added 2 hours ago
TT
Senior Data & Machine Learning Engineer
True Talent Solutions Partners
New York City, NY
- $200,000 to $300,000 USD / year
…models through real-time serving, and help shape the system's technical priorities as it…
Added 2 hours ago
O
Software Development Engineer I, Tools
Optimum
Bethpage, NY
- $83,538 to $137,241 USD / year
This is an excellent opportunity for an early-career engineer interested in applying software development, automation, AI-assisted development, systems integration, and problem-solving to…
Added 2 hours ago
Senior Principal Engineer- Autonomous Driving (ADAS) Data Loop & Flywheel
Bosch Group
Sunnyvale, CA
As the Senior Principal Engineer – ADAS & AV Data Loop & AI Flywheel, you will spearhead the architectural strategy, design, and execution of the end-to-end continuous data engine powering…
Added 2 hours ago
RF Engineer Sr Principal
GD Information Technology, Inc.
United States
GDIT is seeking a Sr. Principal RF/Spectrum Systems Engineer to support Counter Unmanned Aircraft Systems (CUAS) engineering for the Federal Aviation Administration (FAA). In this…
Added 2 hours ago
Software Engineering Lead and Application Architect - TS/SCI with Polygraph
GD Information Technology, Inc.
United States
We are seeking a Lead Engineer to drive the end-to-end software engineering function for mission and enterprise applications across classified environments. This role is accountable for…
Added 2 hours ago
Senior Cloud Platform and DevSecOps Engineer - TS/SCI with Polygraph
GD Information Technology, Inc.
United States
DevSecOps, Linux, Microsoft Azure, Microsoft Windows, Systems EngineeringCertifications:
Added 2 hours ago
S
Principal Software Engineer - Observability
Snowflake
Menlo Park, CA
- $264,000 to $379,500 USD / year
…We’re looking for a hands-on, product-minded Principal Software Engineer I to help build an AI-driven observability platform, combining deep distributed-systems engineering with a strong…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 8, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 8, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe prog To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3MDg3Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job