Jobs in the United States

25+ jobs

Save this search

Added just now
PI
Sr Software Engineer
PayPal, Inc.
San Jose, CA
- $143,500 to $212,850 USD / year
…Lifecycle (SDLC) (design, implementation, testing, delivery and operations), based on definitions from more senior…
Added 1 min ago
UG
Senior Principal AI/ML Product Engineer- Full Stack
UnitedHealth Group
Boston, MA
- $184,600 to $316,500 USD / year
…building it so that it runs without them. The Sr Principal AI/ML Engineer works as one team with product, design, clinical, and operations partners, and with great Optum Health engineering…
Added 2 mins ago
S
GPU Kernel Engineer
Sciforium
San Francisco, CA
- $190,000 to $250,000 USD / year
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and…
Added 2 mins ago
UG
Architect - Remote
UnitedHealth Group
Fort Washington, PA
- $112,700 to $193,200 USD / year
Build and maintain solid cross-functional relationships with Product Management, Engineering, Testing, Database, Infrastructure, Security, Support, and Operations teams to enable cohesive…
Added 3 mins ago
Network Engineer
Canopy Standard
Jackson, MS
The Network Engineer is responsible for the design, implementation, administration, and support of the organization's network infrastructure, including Cisco Meraki firewalls, Cisco ASA…
Added 3 mins ago
UG
Principal Cybersecurity Analyst (Attack Surface Mgt.) On Site MN
UnitedHealth Group
Columbia, MD
- $112,700 to $193,200 USD / year
…enterprise-approved AI tools and intelligent automation into daily operations, you will drive operational efficiency and elevate the proactive cyber resilience of healthcare platforms…
Added 3 mins ago
UG
Oracle Exadata DBA - Remote
UnitedHealth Group
New York, NY
- $112,700 to $193,200 USD / year
Join the NY APD and Virginia EDW Analytics Operations and Maintenance team within Optum Technology as a Principal Data Engineer. In this role, you will lead the architecture, design, and…
Added 3 mins ago
Engineering Manager - ARB, Inc.
ARB, Inc
Irvine, CA · AZ · NV
Professional Engineer (PE) license preferred, not required.
Added 5 mins ago
Principal Platform Engineer - People Systems
Apple
Sunnyvale, CA
When you engineer for People Systems, your users are Apple’s most vital asset: its People. We are seeking a visionary Application Architect to shape the technical strategy for People…
Added 5 mins ago
Sr Network Engineer
Disney Entertainment & Sports LLC
Glendale, CA · New York, NY
We are looking for a Senior Network Engineer for Data Center, Backbone, & CDN who is passionate about large-scale network infrastructure. This is a technical leadership role within our…
Added 5 mins ago
Senior Production Site Reliability Engineer - PH
Walt Disney Pictures
Glendale, CA
…building, and supporting development pipelines, automating infrastructure and operations, creating telemetry for monitoring, engineering high reliability, and reinforcing best practices to…
Added 6 mins ago
WW
Sr. Systems Engineer
World Wide Technology
Maryland Heights, MO
- $120,000 to $130,000 USD / year
…software, Information Assurance (IA) settings, IA tools, network infrastructure, network operations, and standard hardware…
Added 9 mins ago
Senior or Principal Civil Engineer
Worley
AB, CA
As a Senior or Principal Civil Engineer, you will lead and deliver civil engineering solutions for environmental remediation, landfill, closure, restoration, and related infrastructure…
Added 10 mins ago
Senior Software Engineer, CAPE
Crusoe
San Francisco, CA · Sunnyvale, CA
We are seeking a Senior Software Engineer to architect, design, and develop Cloud Infrastructure management systems and platforms. You'll deliver end-to-end use cases and workflows for a…
Added 11 mins ago
Field Service Engineer II
HITACHI ENERGY USA INC
Mount Pleasant, PA
…impact for customers? Join Hitachi Energy as a Field Service Engineer and become a trusted technical partner delivering world-class service and support for advanced industrial equipment and…
Added 14 mins ago
Software Development Engineer III, AWS AI/ML Servers
Amazon.com Services LLC
Seattle, WA
We are seeking a Software Development Engineer to design and build the software that operates our accelerated compute fleet: fleet-management services, orchestration and remediation control…
Added 14 mins ago
Software Dev Engineer II, AWS Inspector
Amazon Development Center U.S., Inc.
Herndon, VA
Amazon Inspector helps AWS customers improve their security posture by continuously monitoring their cloud infrastructure and associated workloads against vulnerabilities and exposures.…
Added 14 mins ago
Software Development Engineer II, AWS Inspector
Amazon.com Services LLC
Herndon, VA
Amazon Inspector helps AWS customers improve their security posture by continuously monitoring their cloud infrastructure and associated workloads against vulnerabilities and exposures.…
Added 14 mins ago
RF Test Engineer, Amazon Leo
Amazon Kuiper Manufacturing Enterprises LLC
San Diego, CA
As a RF Engineer, you will be responsible for integration and test activities for various payload related features for the Leo satellite , ground gateway and the customer terminals.
Added 16 mins ago
Staff Software Architect
CVS Shared Services Resources LLC
Remote, United States
Define and govern ML architecture patterns - including feature stores, model registries, model serving infrastructure, experiment tracking, and MLOps pipelines - ensuring reproducibility,…
Added 16 mins ago
Account Executive – Power Generation / Data Centers
UptimeAI
Remote, United States
UptimeAI is transforming industrial operations through its AI-driven platform that maximizes uptime, optimizes asset performance and enhances reliability across heavy industries. Our AI…
Added 18 mins ago
Trolley Infrastructure Manager
Mid-South Transportation Management, Inc.
Memphis, TN
The Manager of Trolley Infrastructure is responsible for the safe, reliable, and effective management of MATA’s trolley infrastructure, including the fixed facilities and systems that…
Added 21 mins ago
IT Network Infrastructure Engineer, Launch
SpaceX
Starbase, TX · Brownsville, TX
As a Network Infrastructure Engineer at SpaceX, you will work in a complex environment designing and supporting a variety of IT systems critical for Starship launch pads. This position will…
Added 21 mins ago
AD
Mobility Engineer
Agile Defense
Ashburn, VA
- $125,000 to $135,000 USD / year
Serve as a Mobility Engineer enabling the Department of Homeland Security (DHS) mission and enterprise MDM infrastructure.
Added 23 mins ago
Enterprise Data Center Instructional Designer
Prime Data Centers
Remote, United States
The Enterprise Data Center Instructional Designer builds the eLearning that keeps data center operations staff safe, compliant, and proficient. You will turn procedures, equipment…

Amazon.com Services LLC

Software Development Engineer III, AWS AI/ML Servers

Seattle, WA, United States

Apply About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Sep 8, 2026

Original job description

AWS runs the world's largest fleet of AI/ML accelerator servers. When a model with billions of parameters trains across a large scale of GPUs, the software that provisions, monitors, and heals that fleet is what keeps training on track. We build the services, control planes, and data platforms that turn hundreds of thousands of servers into a reliable, self-managing system. If you want to build software at the intersection of large-scale distributed systems and the physical infrastructure powering frontier AI, this is the role.

We are seeking a Software Development Engineer to design and build the software that operates our accelerated compute fleet: fleet-management services, orchestration and remediation control planes, telemetry and analytics pipelines, and the APIs and tools that engineering, operations, and partner teams depend on. You will own software from design through production, working across multiple teams and organizations to deliver scalable, reliable services.

What You Will Do

You will design and build distributed services and data platforms that manage the fleet end to end. You will turn ambiguous problems into well-architected software: designing APIs, choosing data models, making the latency, availability, and cost trade-offs that come with operating at fleet scale. You will build the control planes that automate provisioning, health evaluation, and remediation, and the pipelines that transform raw telemetry into signals other teams act on. When your service catches and routes a failing node automatically before it disrupts a training job, that is your impact.

Why You Will Love It

Your software runs across a large scale of servers in the cloud, and you see its impact on fleet availability within days of shipping. You solve genuinely hard distributed-systems problems, own services end to end, and work close enough to the hardware to understand exactly what your software is managing. The team is small enough that your design decisions shape the architecture, and large enough that you always have experts to learn from across software, hardware, and operations.

The Ideal Candidate

You are a strong software engineer first: you design clean abstractions, write high-quality, testable code, and reason about correctness, scalability, and failure modes. You care about the customer of your software, whether that is an operations engineer, a partner service, or an internal tool user. You communicate clearly, raise the engineering bar for your team, and can partner with hardware, firmware, and operations engineers to build software that reflects how the fleet actually behaves.

Key job responsibilities Service & Platform Development

Design, build, and operate scalable distributed services and control planes that automate fleet provisioning, health evaluation, and remediation across a large scale of servers
Design APIs, data models, and system architectures that balance latency, availability, durability, and cost at fleet scale
Own software end to end: design, implementation, testing, deployment, and production operations, following engineering best practices for code review, source control, and CI/CD

Data & Telemetry Platforms

Build data and telemetry pipelines that ingest, correlate, and transform signals from across the fleet into actionable insights and automated actions
Develop analytics and reporting services, dashboards, and alerting that give engineering and operations teams real-time visibility into fleet health
Apply appropriate algorithms and data structures to process high-volume telemetry efficiently and reliably

Reliability & Operational Excellence

Instrument services for observability; participate in post-incident reviews, identify contributing causes, and drive permanent software fixes that eliminate whole classes of risk
Improve the resilience, performance, and cost of the services you own, and reduce operational load through automation
Produce clear, maintainable documentation for services, APIs, and runbooks so others can operate and extend your work

Technical Leadership & Collaboration

Decompose complex problems into well-scoped components that you and other engineers can deliver in parallel
Partner with systems, firmware, hardware, and operations engineers to translate fleet behavior into software requirements and correct abstractions
Review designs and code, mentor engineers, and set engineering standards for the team

May require occasional (Basic qualifications

5+ years of non-internship professional software development experience
5+ years of programming with at least one software programming language experience
5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience as a mentor, tech lead or leading an engineering team
Bachelor's degree in Computer Science, Engineering, a related field, or equivalent experience Preferred qualifications
5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
Experience leading the design, development and deployment of business software at scale or recent hands-on technology infrastructure, network, compute, storage, and virtualization experience
Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
Familiarity with the infrastructure the software manages, such as Linux, server hardware, BMC/IPMI, or GPU/accelerator platforms

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually

Apply About employer

More about this job

Skills

Software development
AWS
ML
Data models
Firmware
CI/CD
Reporting
Documentation
Leadership
Collaboration
Computer science
Linux
Recruitment
Mental health

Report this job