Jobs in the United States

25+ jobs

Save this search

Added 10 mins ago
Senior MLOps Engineer
C the Signs
Remote, United States
We’re hiring a Senior MLOps Engineer with deep machine learning engineering experience to build and operate the production platform powering ML/LLM-driven healthcare workflows. You’ll…
Added 10 mins ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 10 mins ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 10 mins ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 10 mins ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 10 mins ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 53 mins ago
Senior Applied AI Engineer (Enterprise AI / Python)
Brightplan
Remote, United States
We are looking for a Senior Applied AI Engineer to help design, build, and scale the systems that power AI across the BrightPlan platform. This role will play an important part in shaping…
Added 1 hour ago
BN
Senior Infrastructure Engineer - GPU Compute
Boundless Networks, Inc.
Remote, United States
- $175,000 to $250,000 USD / year
Boundless is coordinating GPU compute at scale as it becomes a leader in AI. As a Senior Infrastructure Engineer (GPU Compute), you'll build and operate the compute fabric that powers our…
Added 1 hour ago
Senior Software Engineer, AI/ML Network Engineering
Cisco Systems, Inc.
Milpitas, CA
…solving complex technical challenges and building large-scale distributed systems. The team operates in a fast-paced, collaborative environment where engineers take ownership across the…
Added 2 hours ago
W
Senior Manager, Electrical Engineering
Walmart
BENTONVILLE, AR
- $90,000 to $180,000 USD / year
The Senior Manager, Electrical Engineering is responsible for leading enterprise electrical safety and reliability programs across Walmart, Sam’s Club, and Supply Chain facilities. This…
Added 2 hours ago
Senior Contract Software Engineer (Data & Platform)
Nimble
Remote, United States
Strong distributed systems fundamentals: queues, retries, idempotency, concurrency, failure modes, and how to reason about them.
Added 3 hours ago
Senior Software Engineer (AI-Native)
Telegent, Inc.
Pleasant Grove, UT
Distributed systems and data. Deep, hands-on experience across transactional, wide-column, streaming, analytical, ledger, cache and object stores, and the judgment to use each one well.
Added 3 hours ago
Senior AI Operations Engineer (Senior Software Engineer)
Vizient, Inc.
Centennial, CO
Added 3 hours ago
Senior AI Operations Engineer (Senior Software Engineer)
Vizient, Inc.
Centennial, CO
Added 3 hours ago
MI
Senior Cloud Systems Administrator
Maxar Intelligence I
Westminster, CO
- $109,000 to $167,000 USD / year
Added 4 hours ago
TA
MEO Missile Warning & Tracking (MWT) SEIT Engineer
The Aerospace Corpor
Colorado Springs, CO
- $117,300 to $175,900 USD / year
The Defense Systems Group (DSG) provides analysis-based decision support to senior leaders on space architectures, policy and strategy, technology development, warfighter capability…
Added 4 hours ago
TA
MEO Missile Warning & Tracking (MWT) Lead SEIT Engineer
The Aerospace Corpor
Colorado Springs, CO
- $151,300 to $226,900 USD / year
Minimum Requirements for Senior Project Engineer - Systems Engineering - Acquisition and Systems Engineering:
Added 4 hours ago
Senior Design Engineer
Eaton Corporation
Worcester, MA
Eaton’s Distributed IT division is seeking a Senior Design Engineer to lead the development and enhancement of Data Center Hot Aisle Containment (HAC) solutions. This role is based on site…
Added 6 hours ago
EG
Cloud Engineer
Eliassen Group
Raleigh, NC
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 6 hours ago
M
Senior Software Engineer - CoreAI
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
App Service is a Platform as a Service (PaaS) offering and one of the top services in Azure all-up. As a Senior Software Engineer - CoreAI, you will have a chance to work on the largest…
Added 6 hours ago
M
Software Engineer II
Microsoft
WA · CA · NY · Redmond, WA · Mountain View, CA · Redmond · Mountain View · New York
- $102,100 to $219,200 USD / year
As a Software Engineer II on SPARTANs, you will work across different services and codebases to solve clearly scoped portions of complex engineering problems. You will collaborate with…
Added 6 hours ago
M
Senior Software Engineer
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
As a Staff Engineer - AI Infrastructure Reliability in the AI Infrastructure Engineering Systems team, you will design, implement, and ensure the reliability and quality of engineering…
Added 6 hours ago
M
Principal Software Engineer
Microsoft
WA · Redmond, WA · Redmond
- $142,800 to $304,200 USD / year
10+ years of technical engineering experience, including 5+ years owning architecture for complex, distributed enterprise systems and data platforms.
Added 6 hours ago
M
Senior Software Engineer, Foundry IQ - CoreAI
Microsoft
WA · CA · Redmond, WA · Mountain View, CA · Redmond · Mountain View
- $119,800 to $261,000 USD / year
As a Senior Software Engineer, you will build infrastructure that protects customer data and keeps search services reliable. You will own features through design, coding, testing,…
Added 7 hours ago
DevOps Engineer, Senior
California Physician Services
Darbydale, OH
…Digital Applications' technical products are built . The DevOps Engineer, Senior will report to the Senior Manager, Digital Platform as your direct manager. In this role you will design,…

NVIDIA USA

Senior Software Engineer, Distributed Systems - NIM Factory

Remote, United States

The expected base salary range for this position is 184,000 USD – 287,500 USD.

Apply About employer

Applications open in a new tab.

Job details

Pay: The expected base salary range for this position is 184,000 USD – 287,500 USD.
Experience: 8+ years of shown experience developing performant microservice, cloud software and/or tooling roles
Posting language: English
Posted: Nov 2, 2026

Original job description

NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). The right person for this role brings technical drive and creativity to change the way NVIDIA optimizes and serves performant inferencing for every AI model in a heterogeneous cluster environments. Our NIM offerings are easy to use, highly performant and tested in all deployment scenarios, in the cloud, on customer’s self-hosted infrastructure and locally on all NVIDIA GPUs. You will apply your deep technical expertise to design an efficient, scalable and reliable automation factory infrastructure that will take AI models to become NIMs that are validated for best in class performance and accuracy.

NVIDIA is building a new category of products, by intersecting our prowess in deep learning and computing, with industry-leading technologies. You will harness groundbreaking technologies, and build a highly efficient factory to power how NVIDIA builds and validates NIMs for inferencing all the way through deployment in heterogeneous hardware and software environments. You will influence and drive technical advances in NVIDIAs workflows and build the infrastructure that strives to accelerate the delivery of every AI model on NVIDIA's GPUs anywhere. We are looking for technical talent to design and build our factory capabilities, including the underlying infrastructure, pipelines, backends, Docker build, test harness, metrics, performance engineering, log ingestion, and more.

What you'll be doing:

Develop a factory pipeline that will take an AI model in and produce a deployable service that is validated across Cloud, On-prem and Kubernetes environments. With the team, define and deliver rapid iterations on the group's technical strategies and roadmaps to deliver and improve the NIM factory. You will be designing interfaces, data modeling and schema design, and expanding observability over the factory pipeline and its compute infrastructure.
Work with technical leaders designing and developing scalable and reliable factory components. You will collaborate with multiple AI model teams to understand their requirements to build an efficient infrastructure that improves every teams' productivity.
Define metrics and drive improvements based on user feedback. You will mentor and collaborate throughout the team and with other teams to grow your colleagues and yourself. You will have a history of learning and growing your skills and those around you.

What we need to see:

A history of using your advanced programming skills to build distributed and compute systems, backend services, microservices and cloud technologies.
Effective experience working with multi-functional teams, principals and architects, across organizational boundaries.
Mentorship, growing teams and team members, and the flexibility to ability to adjust your direction and expectations given the needs of our customers.
Deep technical expertise in distributed containerize applications using technologies such as Docker, K8s, Cloud Endpoints, Helm, and Prometheus.
Passion for building rich, microservice applications build and test automation pipeline.
Excellent interpersonal skills and the ability to lead multi-functional efforts
Proven experience debugging and analyzing the performance of distributed microservices or cloud systems.
BS or MS in Computer Science, Computer Engineering or related field (or equivalent experience)
8+ years of shown experience developing performant microservice, cloud software and/or tooling roles

Ways to stand out from the crowd:

Experience delivering event-driven applications using various services such as Temporal, Kafka, Redis or others and a demonstrable ability to discuss the pros and cons of these choices.
A history of building and deploying containers for Microservices, Cloud and On-prem deployments, and their associated CI/CD pipelines
Prior experience in working with large scale full stack development

We are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and creative people in the world working for us. If you're creative and autonomous with a real passion for technology we want to hear from you.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 184,000 USD – 287,500 USD. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 6, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Apply About employer

Report this job