Jobs in the United States

25+ jobs

Save this search

Added just now
Senior Specialist, Senior Microelectronics Failure Analysis Engineer
L3Harris
Palm Bay, FL
Job Title: Senior Specialist, Senior Microelectronics Failure Analysis Engineer
Added just now
Automated Test Engineer (Edifecs)
Syms Strategic Group, LLC (SSG)
Clearwater, FL
Syms Strategic Group (SSG) is seeking a talented Automated Test Engineer (Edifecs)
Added just now
Senior Software Test Engineer
Syms Strategic Group, LLC (SSG)
Clearwater, FL
Syms Strategic Group (SSG) is seeking a talented Senior Software Test Engineer
Added just now
Software Developer in Test (SDET)
Syms Strategic Group, LLC (SSG)
Clearwater, FL
NOTE: This is NOT an SQA tester position. Candidates MUST have strong programming skills, often in languages such as C#, .Net, Java, or Python.
Added just now
Automated Test Engineer (Edifecs)
Syms Strategic Group, LLC (SSG)
Melbourne, FL
Syms Strategic Group (SSG) is seeking a talented Automated Test Engineer (Edifecs)
Added just now
Software Developer in Test (SDET)
Syms Strategic Group, LLC (SSG)
Melbourne, FL
NOTE: This is NOT an SQA tester position. Candidates MUST have strong programming skills, often in languages such as C#, .Net, Java, or Python.
Added just now
Senior Software Test Engineer
Syms Strategic Group, LLC (SSG)
Melbourne, FL
Syms Strategic Group (SSG) is seeking a talented Senior Software Test Engineer
Added just now
Senior Software Engineer, Infrastructure, Google Workspace
Google
Los Angeles, CA
5 years of experience programming in C++, Java, Go or Python.
Added just now
Senior Software Engineer, AI/ML GenAI, Core
Google
Kirkland, WA
5 years of experience programming in Python or C++.
Added just now
Senior Forward Deployed Engineer
JeffreyM Consulting
San Francisco, CA
We are looking for a Senior Forward Deployed Engineer with 2–6 years of experience to own our client's deployments at some of the largest chip companies in the world. You're a highly…
Added 1 min ago
Senior Analyst, Compliance Technology
Coinbase
Tallahassee, FL
We're hiring an Analytics Engineer to join the Compliance Technology team within the Platform organization. This team builds and operates data and detection capabilities that enable…
Added 1 min ago
CH
Data Analyst
Cayuse Holdings
Tallahassee, FL
- $100,000 to $110,000 USD / year
The Data Engineer/Analyst collaborates with clients, data scientists, and software engineers to develop and optimize data pipelines, ETL processes, and database structures that support IRS…
Added 1 min ago
AWS Connect Developer
ASM Research, An Accenture Federal Services Company
Tallahassee, FL
…services. The role develops interactive voice response (IVR) flows, Python-based functions, and secure API integrations that connect customer interactions with enterprise applications and…
Added 1 min ago
O
Senior Database Site Reliability Engineer – Oracle Database and GoldenGate (IC3)
Oracle
Tallahassee, FL
- $81,100 to $187,000 USD / year
Oracle Health Database Services is seeking a highly experienced, Site Reliability Engineer to lead database reliability engineering across mission-critical healthcare platforms.
Added 1 min ago
Principal CloudOps Engineer
Vertafore
Denver, CO
The Principal Cloud Engineer is a senior individual contributor responsible for designing, advancing, and governing the AWS platforms that support our B2B SaaS products. This role combines…
Added 1 min ago
AI Automation Architect - Manufacturing and MES processes- Remote
Cognizant
Tallahassee, FL
…fundamentally connect people with processes. Within Cognizant IOT, we engineer industry-aligned, IoT-enabled products that merge industry needs with human drivers. Our intelligent products…
Added 1 min ago
Software Engineer
Teradata
Tallahassee, FL
This position is for a Software Engineer in the POD Services team within the TD Factory team. The position involves development, integration, functional and performance testing, and fault…
Added 1 min ago
Avionics Test Engineer II
Blue Origin LLC
Seattle, WA
Added 1 min ago
Senior Network Engineer
Cognizant
Tallahassee, FL
Cognizant is seeking a Senior Network Engineer to design, implement, secure, operate, and optimize enterprise datacenter, campus, branch, wireless, and hybrid-cloud networks. This role…
Added 1 min ago
Software Engineer, Infrastructure - Central Growth
Meta
Tallahassee, FL
Software Engineer, Infrastructure - Central Growth Responsibilities:
Added 1 min ago
Lead Site Reliability Engineer - Remote
SitusAMC
Tallahassee, FL
Experience in Scripting and Automation using any Scripting Language preferably Python
Added 1 min ago
AI Native Software Engineer - Americas Market
Accenture
Saint Louis, MO
A senior engineer who can build and operate an entire production system. You work across application and product engineering, APIs and services, data, cloud infrastructure, DevSecOps,…
Added 1 min ago
Cloud Patch Engineer
NTT America, Inc.
Jacksonville, FL
We are currently seeking a Cloud Patch Engineer to join our team in jacksonvile, Florida (US-FL), United States (US).
Added 1 min ago
A
Automation & Tools Engineer
Alembic
San Francisco, CA
- $185,000 to $205,000 USD / year
We’re looking for an experienced Senior Automation and Tools Engineer to help us scale our platform with reliability, observability, and operational excellence at the core. You’ll partner…
Added 1 min ago
Automated Test Engineer (Edifecs)
Syms Strategic Group, LLC (SSG)
Tampa, FL
Syms Strategic Group (SSG) is seeking a talented Automated Test Engineer (Edifecs)

ARM

Principal Software Engineer, AI Inference Runtime

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Jan 1, 2027
Experience: 8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Posting language: English
Posted: Oct 13, 2026

Original job description

As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference runtime for running SOTA AI Models.

You will lead hands-on work across scheduling, batching, KV-cache management, memory allocation, distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work will directly influence how efficiently new models use available compute. Partnering with our AI Infrastructure, compute, and product teams to enhance the performance and efficiency of Arm's AI platform.

Responsibilities:

Define the architecture, interfaces, and roadmap for AI inference runtime capabilities, including abstractions that support evolving models, workloads, and compute platforms.
Enable new model architectures end to end through operator support, production validation, and optimization of scheduling, batching, model execution, memory management, and KV-cache efficiency.
Profile system bottlenecks and develop optimized kernels and data-movement paths across compute, memory, networking, and framework integration.
Evaluate new inference techniques and build benchmarking, regression, validation, and safe-rollout systems to improve latency, throughput, reliability, and resource efficiency.
Partner with cloud, framework, compiler, hardware, and research teams; lead technical reviews, mentor engineers, and establish meticulous performance-engineering practices.

Required Skills and Experience :

8+ years of experience, or equivalent demonstrated impact, in ML systems, high-performance systems, compilers, kernel development, or production AI inference.
Deep understanding of modern AI inference, including model execution, Attention, MoE, batching, prioritisation, and KV-cache behavior.
Strong programming skills in C++, Rust, Python, or a comparable language, with knowledge of concurrency, parallel programming, handling of memory resources, and data movement.
Proven ability to profile, debug, and optimize performance across kernels, runtimes, frameworks, operating systems, and hardware.

"Nice To Have" Skills and Experience :

Experience developing or modifying inference schedulers, cache managers, batching systems, disaggregated or distributed execution paths.
Experience optimizing kernels using accelerator programming tools, assembly, or intrinsics, including attention, matrix multiplication, operator fusion, and low-precision execution.
Familiarity with model parallelism, collective communication, high-performance networking, compilers, or graph optimization.
Contributions to open-source ML runtimes, frameworks, compilers, or kernel libraries.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities to support AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. The success of our AI projects will be directly influenced by your work, crafting the company's AI inference capabilities and defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe prog To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjU3NjMxLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job