Jobs in the United States

24 jobs

Save this search

Added 2 hours ago
Senior Forward Deployed Solution Engineer
Spectro Cloud
Remote, United States
We are looking for a Sr. Forward Deployed Solution Engineer (FDSE) who is equally comfortable writing automation, troubleshooting a production Kubernetes cluster, whiteboarding a GPU…
Added 1 day ago
BM
Practice Director, Data & AI - Remote US Only
Blue Mantis
Remote, United States
- $200,000 to $230,000 USD / year
…Responsibilities include practice strategy, offering development, field enablement, strategic partner alignment, and growth of professional, managed, and recurring services across data…
Added 4 days ago
MA
Software Engineer, Compute Infra HPC
Microsoft AI
New York City, NY · Mountain View, CA
- $119,800 to $234,700 USD / year
Build foundational primitives that make new capacity enablement repeatable and secure by default, including cluster bootstrap, Kubernetes control planes, networking, identity and access,…
Added 8 days ago
Validation Engineer – AI & Server Platforms
Advanced Micro Devices, Inc
Austin, TX
We are looking for a dynamic, energetic and passionate technical leader to join our growing datacenter CPU and AI post silicon validation team with expertise in the areas of highspeed IO…
Added 11 days ago
Principal Engineer - Database Platform Engineering & SRE
Lumen Technologies
OR
Principal Engineer – Database Platform Engineering & SRE
Added 11 days ago
Principal Engineer - Database Platform Engineering & SRE
Lumen Technologies
Remote, United States
Principal Engineer – Database Platform Engineering & SRE
Added 12 days ago
N
Systems Engineer - Navy/USMC
Nutanix
Washington, DC
- $175,000 to $263,000 USD / year
Nutanix (NTNX) is looking for a passionate and enthusiastic Systems Engineer (SE) who will act as a trusted advisor to our customer’s beginning as a presales activity while aiding the…
Added 14 days ago
Senior Technical Product Manager, Accelerated Compute Platforms
NVIDIA USA
CA · WA
Own the definition, delivery, enablement, and scheduling of all the bits and bytes-- from modules and chips, to reference board samples and developer kits-- that let people build on NVIDIA.
Added 18 days ago
Technical Marketing Engineer – Datacenter GPU Clusters & Networking
Advanced Micro Devices, Inc
Santa Clara, CA
You are a technically deep, customer-facing engineer who enjoys turning complex system designs into clear, compelling stories. You are equally comfortable discussing GPU architecture,…
Added 19 days ago
Datacenter Partner Enablement Engineer
NVIDIA USA
OR
NVIDIA, the industry leader in AI, is looking for an Early Access Partner Enablement Engineer (EAP) to work with the world's largest cloud service providers (CSPs) and their server…
Added 19 days ago
Lead Hardware Design Validation Engineer - Memory Subsystem
NVIDIA USA
CA
Hands-on leadership of HBM/GDDR enablement, validation, and failure analysis for NVIDIA’s datacenter and graphics products.
Added 19 days ago
Senior MLOps Engineer - DSX Enablement
NVIDIA USA
CA · WA
NVIDIA is seeking a Senior MLOps Engineer to join our DSX Enablement team, collaborating closely with strategic customers to implement and enhance groundbreaking AI workloads. We partner…
Added 19 days ago
Senior Hardware Application Engineer
NVIDIA USA
CA
We are now looking for an Applications Engineer with the ability to focus on customer enablement of enterprise products in a datacenter environment. We seek an expert who is familiar with…
Added 19 days ago
Data Center Power Test Architect
NVIDIA USA
CA
Prior role as a test architect or technical lead for large-scale datacenter enablement or firmware validation programs.
Added 19 days ago
Lead Infrastructure Engineer
JPMC page
Tampa, FL
Partner with application and platform teams to migrate and modernize mainframe-adjacent workloads (e.g., rehost/refactor components, distributed integrations, data movement patterns).
Added 19 days ago
Software Engineer - Research Platform
Optiver
Chicago, IL
…orchestration of complex workflows. By owning the full stack, from datacenter hardware to distributed research tooling, ORP provides the fastest possible turnaround time for experiments and…
Added 19 days ago
Software Engineer - Research Platform
Optiver
Austin, TX
…orchestration of complex workflows. By owning the full stack, from datacenter hardware to distributed research tooling, ORP provides the fastest possible turnaround time for experiments and…
Added 19 days ago
Senior Technical Partnerships Manager
Prime Intellect
San Francisco, CA
You will own our most strategic technical alliances end to end: NVIDIA, hyperscalers, neoclouds, datacenter operators, and the next wave of partners across models, tooling, and enterprise.…
Added 19 days ago
Director, Portfolio Product Marketing
Crusoe
Seattle, WA · San Francisco, CA
- Partner with Product and product-line PMMs on launch calendars, ensuring Revenue Enablement gets months of lead time, not days
Added 19 days ago
D
GRC and Security Compliance Lead
Deepgram
Remote, United States
- $179,000 to $223,300 USD / year
…skeptical reader - an auditor, a Fortune 500 security reviewer, an engineer who knows the system better than you do. Where a claim needs technical verification, you define what has to be…
Added 19 days ago
EA
Principal Solutions Engineer
EnCharge AI
Remote, United States
- $200,000 to $250,000 USD / year
EnCharge AI is looking for a highly experienced, hands-on Principal Solutions Engineer to lead customer and partner solution development, architecture, and deployment for our…
Added 19 days ago
Senior Software Program Manager – CSP Engagements
NVIDIA USA
CA
…hyperscale cloud service providers for NVIDIA’s next‑generation datacenter systems such as Vera Rubin NVL72. This role is intended for experienced systems and embedded software leaders -…
Added 19 days ago
TR
VCF Principal Engineer
The Redesign Group
Remote, United States
- $120,000 to $160,000 USD / year
…manufacturers, and cybersecurity services position us to be a business partner that’s ready for what’s…
Added 19 days ago
Senior Manufacturing Process Engineer – Specialty Wire, Alignment, Jackets & Connectors
AttoTude
Menlo Park, CA
The Senior Manufacturing Process Engineer will lead the development, industrialization, and scale-up of novel manufacturing processes for specialty THz wires, precision alignment, jackets,…

No more jobs.

Microsoft AI

Software Engineer, Compute Infra HPC

New York City, NY, United States
Mountain View, CA, United States

$119,800 to $234,700 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $119,800 to $234,700 USD / year
Posting language: English
Posted: Sep 11, 2026

Original job description

Overview

Microsoft AI is looking for experienced Member of Technical Staff, Software Engineers - Compute Infra/HPC to build the compute infra software that brings frontier AI compute online and keeps it healthy at global scale. You will work across cluster bring-up and automation, fleet and node lifecycle and health, and automated operations at global scale. The systems you build will transform newly delivered compute capacity into secure, observable, schedulable clusters and continuously recover usable capacity when hardware or software fails.

This is a hands-on software engineering role at the boundary of distributed systems and AI supercomputing. You will design control planes, APIs, workflow engines, state models, and hardware-aware automation for some of the largest GPU systems in the world. Rather than relying on manual intervention, you will turn recurring operational workflows and failure modes into durable platform capabilities that improve time to production, fleet availability, and researcher velocity.

Microsoft AI

Our mission is to build AI that amplifies human potential and empowers people around the world. We strive to deliver breakthroughs that advance science, education, productivity, and global well-being.

We’re also fortunate to partner with incredible product teams giving our models the chance to reach billions of users and create immense positive impact. If you’re a brilliant, highly-ambitious and low ego individual, you’ll fit right in - come and join us as we work on our next generation of models!

MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location. This expectation is subject to local law and may vary by jurisdiction.

Responsibilities

Design and build distributed services, control planes, and platform APIs for the end-to-end lifecycle of AI compute clusters, from capacity ingestion and provisioning through certification, upgrades, maintenance, repair, and decommissioning.
Build foundational primitives that make new capacity enablement repeatable and secure by default, including cluster bootstrap, Kubernetes control planes, networking, identity and access, image distribution, secrets, infrastructure as code, and cluster metadata across Azure and partner clouds.
Own software systems that reduce cluster bring-up time by automating rack and node qualification, topology validation, scale testing, and the transition from newly delivered hardware to healthy, schedulable fleet.
Develop the node and fleet health platform that combines telemetry, health signals, diagnostics, and lifecycle state to detect, isolate, and remediate unhealthy hardware, hosts, networks, and storage with minimal human intervention.
Build policy-driven and agent-assisted automation for certification, maintenance, safe rollout or rollback of software and platform components.
Use production evidence, benchmarks, workload profiles, and fault injection to improve system architecture, efficiency, failure detection, recovery time, and the quality of health and readiness decisions.
Translate incidents and repeated operational work into durable software, stronger abstractions, automated guardrails, and clear ownership boundaries rather than one-off manual procedures.
Partner closely with researchers, hardware health, networking, storage, security, and datacenter teams to shape the long-term architecture of Microsoft AI compute infrastructure.
Provide technical leadership through design reviews, architecture decisions, code quality, mentoring, and execution of complex cross-team initiatives.
Embody our culture and values.

Qualifications

Required Qualifications:

Bachelor's Degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field AND 4+ years of software engineering experience building production distributed systems, infrastructure platforms, or control-plane services
OR equivalent experience
4+ years of experience designing and implementing scalable software for cloud, datacenter, cluster, or fleet infrastructure using one or more general-purpose languages such as Go, Rust, C++, C#, Java, or Python
Experience with Kubernetes or comparable cluster-orchestration systems, Linux systems, public-cloud infrastructure, and infrastructure-as-code or declarative configuration
Demonstrated ability to debug complex behavior across service, control-plane, operating-system, networking, and hardware boundaries and turn findings into robust software improvements
Experience leading projects across multiple teams and communicating technical tradeoffs clearly to engineering and non-engineering stakeholders

Preferred Qualifications:

Master's Degree in Computer Science or a related technical field AND 6+ years of software engineering experience building distributed systems or infrastructure platforms
OR equivalent experience
Experience building or managing compute infrastructure at hyperscale, such as fleets with thousands of nodes, multiple clusters, heterogeneous accelerator generations, or capacity spanning multiple cloud and datacenter providers
Experience with cluster and node lifecycle systems, including bare-metal provisioning, cluster bring-up, health checking, certification, maintenance, repair automation, capacity management, or decommissioning
Depth in Kubernetes internals or related orchestration technologies, including controllers and operators, scheduler, autoscaler, kubelet, Cluster API, container runtimes, or workflow engines
Experience building cloud foundations, including virtual networking, CNI, private connectivity, DNS, workload identity, RBAC, secrets, image and artifact distribution, and Terraform or equivalent infrastructure-as-code systems
Experience designing health, diagnostics, and remediation platforms using event-driven architectures, durable workflows, state machines, telemetry pipelines, automated decisioning, and safe recovery mechanisms
Low-level systems experience with Linux kernels, device drivers, firmware, BMC or Redfish, secure boot or attestation, virtualization, or hardware-health agents
Experience with GPU or accelerator systems and high-performance interconnects such as InfiniBand, RoCE or RDMA, NVLink, NCCL or collective communication, as well as high-performance storage and data movement
Experience owning production reliability and incident response while systematically eliminating recurring toil through software and automation
Dedication to writing clean, testable, maintainable, secure, and well-documented code, with strong engineering judgment around correctness, scalability, operability, and long-term platform evolution
Ability to create alignment across senior stakeholders, mentor engineers, and drive complex multi-quarter technical initiatives from architecture through production adoption
Passion for learning rapidly evolving infrastructure technologies and for making enormous compute systems more reliable, efficient, understandable, and easy to use

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Apply About employer

Report this job