Jobs in the United States

25+ jobs

Save this search

Added just now
G
Engineering/Estimating Sales Rep, Japanese
GPAC
Chicago, IL
- $80,000 to $100,000 USD / year
Turnkey Project Development & Execution Key Tasks
Added just now
G
Engineering/Estimating Sales Rep, Japanese
GPAC
Chicago, IL
- $80,000 to $100,000 USD / year
Turnkey Project Development & Execution Key Tasks
Added just now
G
Engineering/Estimating Sales Rep, Japanese
GPAC
Chicago, IL
- $80,000 to $100,000 USD / year
Turnkey Project Development & Execution Key Tasks
Added just now
G
Manufacturing Engineer
GPAC
Arlington Heights, IL
- $90,000 to $105,000 USD / year
Our client, a well-established precision manufacturer, is seeking a Manufacturing Engineer to support the design, development, and continuous improvement of manufacturing processes for wire…
Added just now
CB
Senior Data Engineer
Commercial Bank of California
United States
- $135,000 to $170,000 USD / year
Partner with BI developers, analysts, and business stakeholders to translate reporting requirements into scalable data solutions.
Added 1 min ago
FH
Senior Talent Acquisition Specialist
Fenway Health
Boston, MA
- $76,800 to $96,000 USD / year
Talent Acquisition: Partner closely with the HR team and hiring managers to identify workforce needs, explore creative and innovative recruitment strategies, build talent pipelines, and…
Added 1 min ago
Principal Supplier Strategist / Small Business Advocate
Dynetics, Inc
Huntsville, AL · Birmingham, AL · Nashville, TN · Atlanta, GA · Knoxville, TN
Partner across Programs, Business Development, Contracts, Engineering, Manufacturing, Finance, and Supply Chain to integrate supplier strategy early in captures, proposals, and program…
Added 1 min ago
SM
New Development Coordinator (CA)
Seabreeze Management Company Inc
Aliso Viejo, CA
- $22 to $25 USD / hour
Seabreeze Management Company is a full-service property management firm with a diverse management portfolio of over 150,000 residential and commercial properties. Based in Aliso Viejo,…
Added 1 min ago
Community Manager (NV)
Seabreeze Management Company Inc
Las Vegas, NV
Seabreeze Management Company is a full-service property management firm with a diverse management portfolio of over 150,000 residential and commercial properties. Based in Aliso Viejo,…
Added 1 min ago
G
Manufacturing Engineer
GPAC
Bensenville, IL
- $90,000 to $105,000 USD / year
Our client, a well-established precision manufacturer, is seeking a Manufacturing Engineer to support the design, development, and continuous improvement of manufacturing processes for wire…
Added 2 mins ago
DIETITIAN
Compass Group
Charlotte, NC · Raleigh, NC · Huntersville, NC · Birmingham, AL · Mobile, AL · Montgomery, AL · Tuscaloosa, AL · Fayetteville, AR · Little Rock, AR · Chandler, AZ · Phoenix, AZ · Culver City, CA · Fountain Valley, CA · Hayward, CA · Los Angeles, CA · Modesto, CA · Mountain View, CA
Collaboration & Service Excellence: Partner with the food service management team to help achieve patient satisfaction and service goals
Added 3 mins ago
Senior Strategic Sales Manager (m/f/d)
Jobgether
Remote, United States
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Strategic Sales Manager (m/f/d) based in United…
Added 4 mins ago
E
Vice President, Data Governance
Experian
United States
- $225,000 to $325,000 USD / year
Establish and improve data governance policies, standards, and operating procedures (data quality, metadata management, data classification) across NA business units.
Added 5 mins ago
Responsible AI Oversight Manager
ATB
AB, CA · ON, CA
Ready for tomorrow: We want to enable your success through interesting and challenging work, performance enablement, and learning and development.
Added 5 mins ago
AI Literacy and Community Manager
ATB
AB, CA · ON, CA
Change Management & Culture Building: Partner with Change Leaders and Internal Communications to deliver change readiness strategies, demystify AI technology, address change risks/mindset…
Added 5 mins ago
Consumer Intelligence & Strategic Analytics Lead, SVP - US Consumer Cards
Citibank, N.A.
United States
Serve as a trusted analytics partner to senior leadership, delivering insights that support strategic decisions, growth planning, and enterprise priorities
Added 5 mins ago
IT Business Lead Analyst, Vice President
Citibank, N.A.
United States
Consult with business clients to determine system functional specifications and partner with multiple management teams and other units to meet organizational objectives
Added 5 mins ago
Applications Development Technology Lead Analyst, Vice President
Citibank, N.A.
United States
Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and…
Added 5 mins ago
Applications Development Technology Lead Analyst, Vice President
Citibank, N.A.
United States
Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and…
Added 5 mins ago
Residential Real Estate Mortgage Specialist, SAFE Act Loan Officer – Director
Citibank, N.A.
United States
…business and interaction with other functions or businesses. Full management responsibility for multiple teams, including management of people, budget and planning, to include duties such…
Added 5 mins ago
SC
Safety and Quality Operations Coordinator
St. Charles Health System
Bend, OR
- $53,400 to $80,100 USD / year
REPORTS TO POSITION: Director, Quality Management
Added 5 mins ago
Manager, Human Resources
Core Civic
PAHRUMP, NV
…safety and health, wage and salary administration, performance management, and employment which includes recruiting, placement, on-boarding, and staff development. They develop, implement,…
Added 5 mins ago
AVP of Financial Planning & Analysis
Akin
Seattle, WA
…Planning & Analysis will serve as a key strategic financial partner, helping shape organizational priorities, strengthen financial operations, and support informed decision-making across…
Added 6 mins ago
Enterprise TM - Dallas- Fort Worth
HPE
All, TX
Partner organization intelligence aligned with partner management skills.
Added 6 mins ago
Senior Director, Storage as a Service
HPE
Andover, MA
Partner closely with core storage product management and engineering teams to translate service requirements into underlying platform capabilities, including areas such as multi-tenancy,…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job