Jobs in the United States

25+ jobs

Save this search

Added just now
V
Ecommerce Product Manager
Vesync
Tustin, CA
- From $95,000 USD / year
Connect the Funnel: Work with MarTech, Lifecycle, and Paid on tracking, data, and the handoff from ad or email to page.
Added just now
UI/UX Developer
FiberFirst
Southlake, TX
As the UI/UX Developer, you will own the design and front-end build of FiberFirst’s customer-facing digital products: the website, the customer mobile application, and the self-service…
Added just now
Automation and AI Enablement Engineer
FiberFirst
Southlake, TX
Work with spatial and operational data in PostgreSQL/PostGIS and the enterprise analytics platform to support automated decisions.
Added just now
YI
Production Technician, 3rd Shift
York International Corp.
United States
- $27.35 USD / hour
…resilience required in rapidly expanding industries such as data centers, healthcare, pharmaceuticals, advanced manufacturing, and higher education. For more than 140 years, Johnson…
Added just now
Content Designer
SuperSummary
Remote, United States
…books. We’re building the world’s most comprehensive literature platform - combining over 10,000 expert-crafted Study Guides with interactive, innovative tools that make reading more…
Added 1 min ago
SAP IS-U ABAP Developer Consultant - Resources/Utilities
Accenture LLP Company
NY
…across S/4HANA Cloud (RISE and GROW), SAP Business Technology Platform (BTP), Clean Core, and SAP Business AI (Joule, Joule Studio, Generative AI Hub). Powered by our myConcerto platform…
Added 1 min ago
Design and Analysis Engineer (Electronic Sys Design & Analy)
The Boeing Company
Berkeley, MO
+ Define logical and software interfaces to ensure compatibility with the platform architecture and ensure proper interoperability with other subsystems
Added 1 min ago
Senior Ads Sales Account Manager
N3, LLC Company
United States
We are seeking an experienced Senior Ads Sales Account Manager to manage and grow a portfolio of SMB advertisers on an emerging advertising platform for a global AI company.
Added 1 min ago
Forward Deployed Engineer - Databricks - Forensic Discovery & Financial Crime
Deloitte
Saint Louis, MO
+ 3+ years of experience in software engineering, data engineering, data science, analytics engineering, or technical delivery roles, with experience in Amazon Web Services (AWS), Microsoft…
Added 1 min ago
SAP IS-U ABAP Developer Manager - Resources/Utilities
Accenture LLP Company
NY
…across S/4HANA Cloud (RISE and GROW), SAP Business Technology Platform (BTP), Clean Core, and SAP Business AI (Joule, Joule Studio, Generative AI Hub). Powered by our myConcerto platform…
Added 1 min ago
Forward Deployed Engineer - Databricks - Forensic Discovery & Financial Crime
Deloitte
Kansas City, MO
+ 3+ years of experience in software engineering, data engineering, data science, analytics engineering, or technical delivery roles, with experience in Amazon Web Services (AWS), Microsoft…
Added 1 min ago
SAP Basis/Technology Senior Manager - Resources
Accenture LLP Company
NY
You have familiarity with adjacent platform domains (SAP Integration Suite, SAP Event Mesh, SAP Data Sphere) sufficient to advise on cross-platform architecture decisions.
Added 1 min ago
Salesforce Data Cloud & AI Tech Architect (Tech Architecture/Solution Architecture)
Accenture
Saint Louis, MO
+ Solution design ownership - lead end-to-end solution design across assigned workstreams, including data model, integration patterns, security model, and platform configuration; keep SDDs,…
Added 1 min ago
SAP Smartfield Senior Manager - CMT / Cross
Accenture LLP Company
NY
…BTP, IoT, Cloud automation, ML and AI. We built myConcerto platform, which serves as a repository of Industry Best Practices, Business Process Hierarchies, Solution Templates, Business…
Added 1 min ago
Oracle Batch Lead (OUAF, C2M/CC&B)
Accenture
Saint Louis, MO
…utility business process-from billing runs and meter reads to data conversion and interface orchestration. You combine hands-on Oracle Utilities Framework experience with sharp scripting…
Added 2 mins ago
Salesforce Data Cloud & AI Architect Senior Manager
Accenture
Saint Louis, MO
You are a senior Data Cloud and AI Architect within Accenture's Life Sciences Salesforce Business Group. You design enterprise-scale solutions at the intersection of Salesforce Data Cloud,…
Added 3 mins ago
M
Senior Digital Designer
Medallia
McLean, VA
- $90,000 to $130,000 USD / year
Medallia is the pioneer and market leader in Experience Management. Our award-winning SaaS platform, Medallia Experience Cloud, leads the market in the management of experiences, insights,…
Added 3 mins ago
Program Operations Specialist (NE S 6)
University of Washington
Seattle, WA
Data management of sensitive quality improvement data and patient information using REDCap
Added 4 mins ago
Associate Information Management Officer - Data, Information & AI Governance
World Bank Group
Washington, DC
…trust, agility, and responsible innovation in the organization’s data, information, and AI landscape. The unit develops and oversees governance frameworks, policies, and stewardship models…
Added 5 mins ago
FSP Scientist - Precision Medicine
Thermo Fisher Scientific
Lawrenceville, NJ
…workflows, local versus central concordance monitoring and data reconciliation, biospecimen planning, and diagnostic partner coordination and tracking. These activities enable timely,…
Added 5 mins ago
Design and Analysis Engineer (Electronic Sys Design & Analy)
The Boeing Company
Berkeley, MO
+ Define logical and software interfaces to ensure compatibility with the platform architecture and ensure proper interoperability with other subsystems
Added 5 mins ago
Engineer III - Core HR Technology
Edward Jones
Saint Louis, MO
The Core HR Technology team is responsible for the systems that manage associate and contractor data across the firm. We are currently implementing a new HCM platform and modern technology…
Added 6 mins ago
UG
Senior Software Engineer
UnitedHealth Group
Eden Prairie, MN
- $91,700 to $163,700 USD / year
…outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers,…
Added 6 mins ago
Software Developer
WinCo Foods
BOISE, ID
A Software Developer researches and analyzes business requirements and user specifications to effectively design, code, test, document, and implement new and maintain existing software…
Added 7 mins ago
RH
Director of Cybersecurity
Robert Half
West Valley City, UT
- $71.25 to $82.5 USD / hour
Lead the development and execution of enterprise cybersecurity strategies that protect systems, data, and business operations across the organization.

ARM

Staff Software Engineer, AI Inference Runtime

Seattle, WA, United States

$209,100 to $282,900 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $209,100 to $282,900 USD / year
Apply by: Nov 22, 2026
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$209,100-$282,900 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjc3MzY5Ljg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

More about this job

Skills

Scheduling
ML
C++
Rust
Python
Assembly
Communication skills

Report this job