Jobs in the United States

25+ jobs

Save this search

Added just now
Vice President – Full Java Stack Engineer
ewminds consulting Services
Pittsburgh, PA
…with the leading staffing trade associations, training, and research organizations to ensure we are knowledgeable of the latest industry trends and…
Added just now
Senior Vice President, Infrastructure Engineering (Mainframe Communications Systems Software Engineer
ewminds consulting Services
Jersey City, NJ
…with the leading staffing trade associations, training, and research organizations to ensure we are knowledgeable of the latest industry trends and…
Added just now
Vice President – Full Java Stack Engineer
ewminds consulting Services
New York, NY
…with the leading staffing trade associations, training, and research organizations to ensure we are knowledgeable of the latest industry trends and…
Added just now
Senior Forward Deployed Engineer (FDE Lead
ewminds consulting Services
East Pittsburgh, PA
…with the leading staffing trade associations, training, and research organizations to ensure we are knowledgeable of the latest industry trends and…
Added just now
Full Stack Engineer
ewminds consulting Services
Clairton, PA
…with the leading staffing trade associations, training, and research organizations to ensure we are knowledgeable of the latest industry trends and…
Added just now
Senior Pre-Sales Infrastructure/Network Design Engineer
ewminds consulting Services
New York, NY
…with the leading staffing trade associations, training, and research organizations to ensure we are knowledgeable of the latest industry trends and…
Added 1 min ago
Senior Operational Systems Engineer
Volume Integration
Chantilly, VA
…systems operating reliably. As a Senior Operational Systems Engineer in Chantilly, VA, you'll support the configuration, maintenance, and evaluation of specialized IT environments that…
Added 2 mins ago
Associate Director - Construction
Turner & Townsend
Dallas, TX
…for coordinating with the general contractor and architect/engineer services provider for all construction related activities on the project, including but not limited…
Added 4 mins ago
R&D Engineer 2 - 142081
UC San Diego/UC San Diego Health
San Diego, CA
…specialized engineering field on a major training and / or research effort. Works on assignments of moderate scope where analysis of situations or data requires a review of a variety of…
Added 4 mins ago
Field Service Engineer I
Thermo Fisher Scientific
Remote, United States
The Field Service Engineer performs customer installs, repairs, qualifications, and preventative maintenance on a variety of ThermoFisher instruments within an assigned territory. Customers…
Added 4 mins ago
RF Engineer
Vast
Long Beach, CA
…for America and its allies, enabling advanced microgravity research and manufacturing, and unlocking a new space economy for government, corporate, and private customers. Haven Demo’s 2025…
Added 5 mins ago
Backend Software Engineer (Node.js) | LabArchives
Dotmatics
Remote, United States
We have a vision for a new Lab of the Future that will change the future of scientific research.
Added 5 mins ago
Data Engineer - Data Domain Architect Associate Senior - Payment Operations
JPMC page
Plano, TX · Tampa, FL
Conduct research and development with emerging technologies, determine their applicability to business use cases, document & communicate their recommended use in the firm.
Added 5 mins ago
CO
C3RS Expert Analyst
Current Opportunities | Craig Technologies
Sunnyvale, CA
- $50 USD / hour
…expert analysis of rail safety reports. Assist with rail safety research efforts under C3RS and assist with project outreach and overall programmatic development and operations. Support the…
Added 5 mins ago
R
Senior Consultant, Biomechanical Engineer
Rimkus
Portland, OR
- $143,600 to $215,400 USD / year
Locates and applies research of pertinent literature and governmental regulations.
Added 5 mins ago
Software Engineer - Front-End Web Applications
National Radio Astronomy Observatory
GREEN BANK, WV · CHARLOTTESVILLE, VA · SOCORRO, NM
The National Radio Astronomy Observatory (NRAO) is a prestigious research and development organization that plays a vital role in the study of the universe. Associated Universities, Inc.…
Added 5 mins ago
Software Engineer - Test and Quality
National Radio Astronomy Observatory
GREEN BANK, WV · CHARLOTTESVILLE, VA · SOCORRO, NM
The National Radio Astronomy Observatory (NRAO) is a prestigious research and development organization that plays a vital role in the study of the universe. Associated Universities, Inc.…
Added 6 mins ago
Senior Project Manager/Technical Lead, Conveyance - New England
Stantec
Burlington, MA · Amherst, MA · South Burlington, VT · Northampton, MA · Auburn, NH · Providence, RI · Hartford, CT · Hingham, MA · Portland, ME · Boston, MA
…opportunities for thought leadership through collaboration with research and innovation teams in the development and deployment of innovative technologies. The successful candidate will be…
Added 7 mins ago
A
Head of Platform & Infrastructure Engineering
Ashby
Remote, United States
- $340,000 to $400,000 USD / year
Added 7 mins ago
Algorithm Engineer
Vantor Inc.
Westminster, CO
Vantor is seeking a highly skilled Algorithm Engineer to join our team and help develop next-generation solutions in computer vision, geospatial analytics, and photogrammetry. This role…
Added 7 mins ago
D
Field Service Engineer - Little Rock, AR
Danaher
Little Rock, AR
- $34 to $38 USD / hour
…clinical testing, and are used in hospitals, reference and research laboratories, and physician offices around the world. Every hour around the world, more than one million tests are run on…
Added 12 mins ago
Lab Technician
Mariana Minerals
Moab, UT
…products. You'll play a critical role in bridging leaching research and lab analytics with plant operations, helping make sure processes are robust, efficient and ready for future…
Added 12 mins ago
Senior Structural Bridge Engineer (56889)
Modjeski and Masters
Charleston, WV
The Charleston, WV office of Modjeski and Masters, Inc is seeking a Professional Engineer (PE) with at least 10 years of Bridge Design Experience working on WVDOT projects.
Added 12 mins ago
Assistant District Bridge Engineer/Design & Review (Civil Engineer V)
MassCareers
MA
Performs the duties of District Assistant Bridge Engineer, including coordinating, monitoring and supervising the activities of the Design unit of the District Bridge Section to ensure…
Added 12 mins ago
Electrical Facilities Maintenance Engineer (Electrical Engineer V)
MassCareers
185 Kneeland Street, MA
Under the direction of the Senior Electrical Engineer or designee, the Electrical Facilities Maintenance Engineer supports the operations of electrical lighting and control systems for…

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

12+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe pro To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjY3OTcyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job