Jobs in the United States

25+ jobs

Save this search

Added just now
FE
GENERAL ENGINEER- DIRECT HIRE AUTHORITY
Federal Energy Regulatory Commission
Washington, DC
- $85,447 to $111,087 USD / year
…"Best Place to Work" in the Federal government! This GENERAL ENGINEER- DIRECT HIRE AUTHORITY position is located in the Office of Energy Projects (OEP) For more information visit: Office of…
Added just now
UA
SUPERVISORY EMERGENCY MANAGEMENT SPECIALIST
U.S. Army Corps of Engineers
Philadelphia, PA
- $117,284 to $152,471 USD / year
…involved in emergency operations. | Represent the District Engineer at disaster coordination meetings involving Regional Directors from several federal agencies, State, and local…
Added just now
AF
SUPERVISORY SERVICE CONTRACT EVALUATOR
Air Force Special Operations Command
Cannon AFB, NM
- $74,678 to $97,087 USD / year
Represents the Service Contracts section and Civil Engineer squadron with a variety of installation and functional area organizations.
Added 1 min ago
Senior Networking Engineer, WBB Platform, GGN WANForms
Google
Thornton, CO
Google is proud to boast a network that provides service to millions of Internet users around the world. The Network Engineering team is responsible for operating that network reliably and…
Added 4 mins ago
VH
Supervisory Healthcare Engineer
Veterans Health Administration
Kings, NY
- $174,922 to $227,406 USD / year
The Facilities Management team is seeking a qualified Supervisory Healthcare Engineer to join their team at the Brooklyn VA Medical Center. Healthcare Engineers provide for a safe,…
Added 5 mins ago
Medical Instrument Technician (Anesthesia)
Veterans Affairs, Veterans Health Administration
West Roxbury, MA
Added 6 mins ago
Manufacturing Engineer 3 - 31037
Huntington Ingalls Industries
Pocasset, MA
Senior Manufacturing Engineer – Unmanned Underwater Vehicles (UUVs)
Added 6 mins ago
Software QA Engineer II Senior - (E2)
Applied Materials
Billerica, MA
…advanced display in the world. The equipment that we create and service is essential to advancing AI and accelerating the commercialization of next-generation semiconductor chips. Join us…
Added 6 mins ago
Sr Software Engineer (HashiCorp Vault)
IBM
LOWELL, MA
We're looking for a seasoned engineer to design, build, and operate HashiCorp Vault as a service. You'll be responsible for secure, highly available, and compliant secrets management…
Added 6 mins ago
Utilities Engineer
Sanofi Group
Framingham, MA
The Utilities Engineer serves as technical owner and subject-matter expert for critical utility and facility systems supporting the MA BioCampus. Systems may include HVAC, high-purity…
Added 6 mins ago
Utilities Energy
Sanofi Group
Framingham, MA
The Utilities Engineer serves as technical owner and subject-matter expert for critical utility and facility systems supporting the MA Bio Campus. Systems may include HVAC, high-purity…
Added 6 mins ago
Senior Equipment Process Engineer - Upstream
Sanofi Group
Framingham, MA
Job Title: Senior Equipment Process Engineer - Upstream
Added 6 mins ago
Senior Equipment Process Engineer- Upstream
Sanofi Group
Framingham, MA
Job Title : Senior Equipment Process Engineer- Upstream
Added 6 mins ago
Senior Equipment Process Engineer- Downstream
Sanofi Group
Framingham, MA
Job Title : Senior Equipment Process Engineer- Downstream
Added 6 mins ago
Senior Equipment Process Engineer- Downstream
Sanofi Group
Framingham, MA
Job Title: Senior Equipment Process Engineer- Downstream
Added 6 mins ago
LCMS Field Service Engineer 1
ThermoFisher Scientific
Cambridge, MA · Waltham, MA
Join us at Thermo Fisher Scientific as a Field Service Engineer, where you'll contribute by ensuring our sophisticated scientific instruments operate at peak performance. In this role,…
Added 6 mins ago
Front End Web Applications Developer (Mid-Level) (5664)
SMX
Boston, MA
SMX is currently looking for a highly motivated Software Engineer - Front End Web Applications to contribute to the design, build, support, and implementation of the Budget and Spend (BAS)…
Added 6 mins ago
Front End Web Applications Developer (Junior) (5660)
SMX
Boston, MA
SMX is currently looking for a highly motivated Software Engineer - Front End Web Application s to contribute to the design, build, support, and implementation of the Budget and Spend (BAS)…
Added 6 mins ago
Senior Software Engineer (Institutional, Financing)
Coinbase
Boston, MA
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added 6 mins ago
Associate Software Engineer
Highmark Health
Boston, MA
This job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. Responsible for…
Added 6 mins ago
Software Development Engineer III, Programming Foundations
Amazon
Boston, MA
…foundational toolchains and libraries used by nearly every service at Amazon, contribute directly to open-source projects, and guide the migration of critical workloads to Rust. If you…
Added 7 mins ago
Senior Engineer
PwC
Boston, MA
As a Senior Engineer you will help design, build, and test custom applications within our Advisory practice, bringing together software engineering, cloud-based solution delivery, and…
Added 7 mins ago
Substation Engineer - Protection and Controls
Jacobs
Boston, MA
…in North America and is looking for a Principal Substation Engineer in its Energy & Power Group to tackle the complexities of decarbonization and utility modernization to deliver a cleaner…
Added 7 mins ago
Lead Substation Engineer - Protection and Controls
Jacobs
Boston, MA
…in North America and is looking for a Principal Substation Engineer in its Energy & Power Group to tackle the complexities of decarbonization and utility modernization to deliver a cleaner…
Added 7 mins ago
Network Operations Engineer
Meta
Boston, MA
Meta is seeking a Network Operations Engineer to join our Edge and Network Services (ENS) Foundation NetOps team. In this role, you will utilize your knowledge in hyperscale data center…

ARM

Principal Software Engineer, AI Inference Cloud

Seattle, WA, United States

$262,700 to $355,400 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $262,700 to $355,400 USD / year
Apply by: Nov 22, 2026
Experience: 12+ years of experience, or equivalent proven impact, building distributed systems, cloud platforms, or production infrastructure.
Posting language: English
Posted: Oct 22, 2026

Original job description

As a Principal Engineer on Arm's AI Inference Cloud team, you will shape the technical direction and develop highly available, scalable services for running AI inference workloads. You will guide architecture and actively contribute to development across Kubernetes orchestration, workload management, service delivery, and observability. Partnering with AI compute, Inference Runtime, and product teams to enhance the performance and usability of Arm's AI platform.

Responsibilities:

Define and build the architecture for cloud-based AI inference services.
Develop Kubernetes controllers and platform capabilities supporting workload deployment, scheduling, recovery, scaling, upgrades, and lifecycle management.
Establish production practices for health validation, progressive rollout, rollback, observability, and service objectives. Improve platform reliability, scalability, performance, and resource efficiency.
Lead production readiness reviews and resolve complex issues across services, Kubernetes, networking, and compute infrastructure. Turn incidents and operational bottlenecks into durable platform improvements.
Lead design and build reviews, mentor engineers, and drive technical alignment across teams.

Necessary Skills and Experience:

12+ years of experience, or equivalent proven impact, building distributed systems, cloud platforms, or production infrastructure.
Deep production experience with Kubernetes, including controllers, operators, scheduling, resource management, networking, and workload lifecycle management.
Strong software and production engineering skills, including hands-on programming in Go, C++, Rust, Python, or a similar language, and experience with reliable services, APIs, concurrency, observability, deployment safety, capacity planning, and incident response.
A track record of leading complex technical initiatives while remaining hands-on, including architecture, implementation, debugging, mentoring, and influencing technical direction across teams.
Ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.

Preferred Skills and Experience:

Experience with AI infrastructure, model serving, or accelerator-backed workloads.
Familiarity with frameworks such as PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and tuning distributed workloads.
Knowledge of inference performance and resource-efficiency considerations.

In Return:

You will be part of our AI Platforms team - A driven and diverse group passionate about developing foundational production capabilities for AI inference at Arm. We provide a collaborative setting where your ideas can come to life quickly. Your work will directly impact the success of our AI projects, shape Arm's AI inference capabilities, defining and operating production inference workloads. This is an outstanding opportunity to work with world-class teams and contribute to groundbreaking advances in AI technology. Join us in building the next generation of AI inference infrastructure!

(Recruiter to Complete)

Additional Information:

Please note that a relocation package (including visa sponsorship support) is available for this role, for candidates who require it.

Salary Range:$262,700-$355,400 per year We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

Our 10x Mindset At Arm, we believe progress happens when people are empowered to think bigg To view the full job description, <a href="https://www.aplitrak.com/?adid=YmJnZW5lcmljLjUzMTIyLjg3NjlAYXJtY29tcC5hcGxpdHJhay5jb20">click here</>

Apply About employer

Report this job