Remote jobs in the United States

25+ jobs

Added 5 hours ago
I
Quantum Software Engineer - Compiler & Control Systems
Infleqtion
Remote, United States
- $145,000 to $170,000 USD / year
This Quantum Software Engineer role will join the Compiler Team within Infleqtion’s Quantum Software organization. The role will design, build, and maintain quantum compilation software,…
Added 9 hours ago
Inference Performance Engineer, Agent Driven Inference Optimization
NVIDIA USA
Remote, United States
NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to…
Added 12 hours ago
Senior Software Engineer - Accelerated Kubernetes Runtime Team
NVIDIA USA
Remote, United States
Join NVIDIA's Accelerated Kubernetes Runtime team and be at the forefront of building the next generation of GPU-accelerated Kubernetes runtime distributions. As a Software Engineer on the…
Added 16 hours ago
Senior Software Engineer, Kubernetes Runtime and Release
NVIDIA USA
Remote, United States
This role suits an engineer who wants direct influence over what reaches production, and who builds for the hundredth cluster while shipping the first. Join us and help build the next…
Added 19 hours ago
Senior/Lead Backend Engineer (Remote)
Fuse Energy
Remote, United States
We're hiring a Senior/Lead Backend Engineer to build the core digital infrastructure for a next-generation energy company. You'll work closely with product across the full back-end and…
Added 19 hours ago
Site Reliability Engineer - Weekend
Vultr
Remote, United States
Vultr is seeking a Site Reliability Engineer (SRE) to join the Platform SRE team, reporting to the Senior Manager, Platform Engineering. The Platform SRE team runs the systems that keep the…
Added 20 hours ago
FW
Senior Platform Engineer
Foresight Works Ltd
Remote, United States
- $180,000 to $240,000 USD / year
We're looking for a Senior Platform Engineer to build the cloud foundation that Foresight runs on.
Added 20 hours ago
FW
Senior Platform Engineer
Foresight Works Ltd
Remote, United States
- $180,000 to $240,000 USD / year
We're looking for a Senior Platform Engineer to build the cloud foundation that Foresight runs on.
Added 21 hours ago
Account Executive - Physics Intelligence
Flexcompute Inc.
Remote, United States
Deliver high-impact demos of GeometryAI automation, Flow360 GPU-native solvers, and Physics Repo continuous learning.
Added 1 day ago
Mojo Libraries Engineer
Modular
Remote, United States
We are looking for a motivated engineer to join the Hardware Enablement team at Modular. In this role you will work across the Modular software stack, from Mojo kernels and the graph…
Added 1 day ago
TT
Senior Full-Stack Engineer
True Talent Solutions Partners
Remote, United States
- $200,000 to $275,000 USD / year
Join a small engineering team building a marketplace for GPU compute. This senior, backend-focused role combines architecture, hands-on development, and product collaboration to deliver…
Added 1 day ago
Senior MLOps Engineer
C the Signs
Remote, United States
We’re hiring a Senior MLOps Engineer with deep machine learning engineering experience to build and operate the production platform powering ML/LLM-driven healthcare workflows. You’ll…
Added 1 day ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 1 day ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 1 day ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 1 day ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 1 day ago
Senior Machine Learning Engineer
C the Signs
Remote, United States
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing,…
Added 1 day ago
BN
Senior Infrastructure Engineer - GPU Compute
Boundless Networks, Inc.
Remote, United States
- $175,000 to $250,000 USD / year
Boundless is coordinating GPU compute at scale as it becomes a leader in AI. As a Senior Infrastructure Engineer (GPU Compute), you'll build and operate the compute fabric that powers our…
Added 2 days ago
Senior Storage Engineer
Runware
Remote, United States
As Senior Storage Engineer, you will own the storage architecture of Runware's AI supercomputer: how model weights, caches and customer data move from object storage on two continents to…
Added 2 days ago
Senior Security Engineer
Runware
Remote, United States
As Senior Security Engineer, you will own the security of Runware's AI supercomputer: the bare-metal GPU fleet, the Sonic Inference Pods it lives in, the managed Kubernetes clusters we hand…
Added 2 days ago
Sr. Solutions Architect/Sales Engineer-AI Infrastructure (GPU) -West Coast
Liqid
Remote, United States
The right person can whiteboard a GPU inference cluster with a customer’s principal engineer, run a disciplined PoC against agreed success criteria, and translate the technical outcome into…
Added 2 days ago
Sr. Solutions Architect/Sales Engineer-AI Infrastructure (GPU) -West Coast
Liqid
Remote, United States
The right person can whiteboard a GPU inference cluster with a customer’s principal engineer, run a disciplined PoC against agreed success criteria, and translate the technical outcome into…
Added 2 days ago
Expert RAG Engineer
Salvo Software
Remote, United States
We are looking for an Expert RAG Engineer to design, build, and own the retrieval-augmented generation systems behind our AI products. Your core work will be architecting production-grade…
Added 2 days ago
Principal Engineer, Model Performance
Runware
Remote, United States
As Principal Engineer, Model Performance, you will own how fast and how cheaply every model on Runware runs: diffusion and video generation, speech, 3D and LLMs, across 400,000+ models and…
Added 2 days ago
Senior Software Engineer, Cloud Platform
Nvidia
Remote, United States
…provisioning to build a multi-tenant infrastructure. As a software engineer, you will work with other software engineers, product architects, and product managers as a collaborative team to…

Inference Performance Engineer, Agent Driven Inference Optimization

Remote, United States

The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3.

Apply About employer

Applications open in a new tab.

Job details

Pay: The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3.
Experience: 3+ years of relevant engineering experience.
Posting language: English
Posted: Nov 9, 2026

Original job description

NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to employ your optimization knowledge in an autonomous optimization framework. AI agents use this framework to repeatedly run benchmark, profile, and tune processes, amplifying the impact of every technique you design. If you enjoy extracting maximum performance from GPUs and scaling your skills beyond your individual efforts, this role is a great fit!

What you'll be doing:

Distill your performance instincts into reusable skills, workflows, and evidence-backed methodologies that AI agents can complete autonomously. Review agent-generated experiments, validate findings, and curate best-known configurations.
Performance improvement of AI inference workloads that methodically increase throughput-per-GPU and user interactivity by exploring configuration options, parallelism techniques, batching, KV cache handling, quantization, and speculative decoding settings.
Measure and optimize both aggregated and disaggregated serving architectures across TensorRT-LLM, SGLang, vLLM, and Dynamo on NVIDIA's latest GPU platforms.
Profile workloads using Nsight Systems, kernel traces, and internal analysis tools. Use roofline and speed-of-light analysis to find credible headroom and drive fixes from hypothesis to measured wins.
Land improvements upstream: serving framework patches, optimized kernels, and deployment recipes that advance the public Pareto frontier while maintaining strict model correctness.
Collaborate with TensorRT-LLM, SGLang, vLLM, kernel, benchmarking, and GPU architecture teams to convert profiling insights into delivered performance improvements.

What we need to see:

BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Math, or a related field, or equivalent experience.
3+ years of relevant engineering experience.
Must have: Extensive knowledge of the efficiency and optimization involved in AI model execution, covering continuous batching, throughput-latency tradeoffs, KV cache and memory limitations, parallel processing techniques, MoE serving, quantization, and meeting serving SLAs.
Must have: Hands-on experience benchmarking and profiling GPU workloads using tools such as Nsight Systems, Nsight Compute, CUPTI, or PyTorch profiler, and interpreting kernel-level performance data.
Strong Python engineering skills and the ability to navigate and modify large C++/CUDA serving codebases.
Rigorous experimental methodology with controlled single-variable comparisons, reproducible benchmarks, and evidence-backed optimization decisions.
Strong written and verbal communication skills to explain performance tradeoffs clearly to both humans and documentation for autonomous systems.

Ways to stand out from the crowd:

Direct contributions to TensorRT-LLM, vLLM, SGLang, FlashInfer, Dynamo, or comparable inference frameworks.
Experience with disaggregated serving, wide expert-parallel MoE inference, KV cache transfer, or NCCL/NIXL/NVSHMEM communication at multi-node scale.
CUDA kernel authorship or optimization experience on Hopper/Blackwell architectures, focusing on Tensor Cores, TMA, and warp specialization.
Proven results on public inference benchmarks such as MLPerf Inference or SemiAnalysis InferenceX.
Experience building or operating agentic AI workflows to automate engineering tasks.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Apply About employer

Report this job