Jobs in the United States

25+ jobs

Added 4 mins ago
Senior Design Quality Assurance - Electrophysiology
Boston Scientific
Arden Hills, MN
The Senior Design Quality Assurance Engineer will bring their leadership to sustaining projects for our innovative Electrophysiology cardiovascular products portfolio. Furthermore, they…
Added 8 mins ago
O
Senior Manager - Quality Engineering
Oracle
Helena, MT
- $126,200 to $264,100 USD / year
The Senior Manager, Quality Engineering is responsible for leading the Quality Engineering organization and ensuring the effective execution of quality strategies across manufacturing…
Added 8 mins ago
CMC Mechanical Analysis Lead Engineer
GE Aerospace
Helena, MT
The Lead Engineer will be responsible for supporting and leading mechanical analysis projects for CMC hot section hardware and/or interfacing metallic components with specific focus on…
Added 9 mins ago
G
Sr Structural Engineer
GPAC
Tampa, FL
- $140,000 to $170,000 USD / year
This is an opportunity for a senior-level structural engineer to lead complex projects, provide technical expertise, work directly with clients, and mentor developing engineers.
Added 11 mins ago
Senior Design Quality Engineer
Divergent
Torrance, CA
Divergent is building the new industrial age. Every day, our teams design, manufacture, and assemble advanced systems for some of the world’s most demanding industries. Our integrated…
Added 15 mins ago
Inference Performance Engineer, Agent Driven Inference Optimization
NVIDIA USA
Remote, United States
NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to…
Added 30 mins ago
Engineer or Principal Engineer Subsystems Electrical
Northrop Grumman
Whiteman Air Force Base, MO
Northrop Grumman Aeronautics Systems is seeking an Electrical Engineer or Principal Electrical Engineer to join our B2 Vehicle Engineering Subsystems and Modifications team. This position…
Added 31 mins ago
Senior Backend Engineer
Acuity Inc.
Conyers, GA
…analytics consumers, and integrating with ERP and downstream systems. This is a hands-on role on a small team, owning services end to end from design through production support. PLM…
Added 36 mins ago
Information Technology Manager (INTERNAL CANDIDATES ONLY)
Golden Empire Transit District
Bakersfield, CA
This classification is distinguished from the Information Technology Systems Analyst/Systems Engineer in that the Systems Engineer has responsibility for specific, assigned IT specialty…
Added 1 hour ago
Principal Systems Software Engineer
NetApp, Inc.
Morrisville, NC · San Jose, CA
We are seeking Senior, Principal and Distinguished Engineers and Technical Leaders to help architect, design, and build technologies that will evolve ONTAP for the AI era. You will solve…
Added 1 hour ago
Principal Systems Software Engineer
NetApp
Durham · San Jose
We are seeking Senior, Principal and Distinguished Engineers and Technical Leaders to help architect, design, and build technologies that will evolve ONTAP for the AI era. You will solve…
Added 1 hour ago
SI
Lead Software Engineer, AI Workflow Generation (Agentforce Operations)
Salesforce, Inc.
CA
- $172,500 to $285,800 USD / year
Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of…
Added 1 hour ago
SI
Senior Software Engineer, Human Agent Interfaces (HAI)
Salesforce, Inc.
CA
- $148,500 to $246,000 USD / year
You have 6+ years of software engineering experience delivering production software, with scope and technical leadership appropriate to the Senior, Lead or Principal level.
Added 1 hour ago
SI
Senior Software Engineer, Human Agent Interfaces (HAI)
Salesforce, Inc.
CA
- $148,500 to $246,000 USD / year
You have 6+ years of software engineering experience delivering production software, with scope and technical leadership appropriate to the Senior, Lead or Principal level.
Added 1 hour ago
Senior R&D Engineer
AVC Medtronic International Trading, Inc.
Santa Ana, CA
The Senior R&D Engineer will serve as a technical expert, executing and providing guidance to the team in achieving innovative engineering solutions. As a design engineer, you will be…
Added 1 hour ago
Senior Principal Engineer III Payload RF Technical Lead- $10K Sign-on Bonus
BAE Systems
Broomfield, CO
Join BAE Space & Mission Systems at a pivotal moment in our company's history, as we expand our presence in the space-based RF sensor systems market. We're seeking a highly skilled and…
Added 1 hour ago
Engineer Senior - Thermal
BAE Systems
Boulder, CO
Employee Benefits: At BAE Systems, we support our employees in all aspects of their life, including their health and financial well-being. Regular employees scheduled to work 20 hours per…
Added 1 hour ago
Engineer Senior Principal II - Ground Systems
BAE Systems
Aurora, CO
We are looking to expand our team with a talented and energetic systems engineer in support of development of ground systems for commercial, DoW, and other government customers. This…
Added 1 hour ago
CMC Mechanical Analysis Lead Engineer
GE Aerospace
Denver, CO · Lafayette, CO · Longmont, CO
The Lead Engineer will be responsible for supporting and leading mechanical analysis projects for CMC hot section hardware and/or interfacing metallic components with specific focus on…
Added 1 hour ago
Manufacturing Engineering, Subassemblies
Vast
Long Beach, CA
Senior Engineer/ Level III: $137,760.00 - $195,552.00
Added 1 hour ago
Manufacturing Engineering, Structures
Vast
Long Beach, CA
Vast is looking for a Manufacturing Engineer, Structures, to help develop the systems behind our human-rated space stations. You will drive the development and execution of human-rated…
Added 1 hour ago
Manufacturing Engineering, ECLSS
Vast
Long Beach, CA
Senior Engineer/ Level III: $137,760.00 - $195,552.00
Added 1 hour ago
Integration Engineer, Fluid Systems Test
Vast
Long Beach, CA
Senior Engineer/ Level III: $137,760.00 - $195,552.00
Added 1 hour ago
Integration Engineer, Avionics Test
Vast
Long Beach, CA
Senior Engineer/ Level III: $137,760.00 - $195,552.00
Added 1 hour ago
Integration Build Engineer
Vast
Long Beach, CA
Senior Engineer/ Level III: $137,760.00 - $195,552.00

Inference Performance Engineer, Agent Driven Inference Optimization

Remote, United States

The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3.

Apply About employer

Applications open in a new tab.

Job details

Pay: The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3.
Experience: 3+ years of relevant engineering experience.
Posting language: English
Posted: Nov 9, 2026

Original job description

NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to employ your optimization knowledge in an autonomous optimization framework. AI agents use this framework to repeatedly run benchmark, profile, and tune processes, amplifying the impact of every technique you design. If you enjoy extracting maximum performance from GPUs and scaling your skills beyond your individual efforts, this role is a great fit!

What you'll be doing:

Distill your performance instincts into reusable skills, workflows, and evidence-backed methodologies that AI agents can complete autonomously. Review agent-generated experiments, validate findings, and curate best-known configurations.
Performance improvement of AI inference workloads that methodically increase throughput-per-GPU and user interactivity by exploring configuration options, parallelism techniques, batching, KV cache handling, quantization, and speculative decoding settings.
Measure and optimize both aggregated and disaggregated serving architectures across TensorRT-LLM, SGLang, vLLM, and Dynamo on NVIDIA's latest GPU platforms.
Profile workloads using Nsight Systems, kernel traces, and internal analysis tools. Use roofline and speed-of-light analysis to find credible headroom and drive fixes from hypothesis to measured wins.
Land improvements upstream: serving framework patches, optimized kernels, and deployment recipes that advance the public Pareto frontier while maintaining strict model correctness.
Collaborate with TensorRT-LLM, SGLang, vLLM, kernel, benchmarking, and GPU architecture teams to convert profiling insights into delivered performance improvements.

What we need to see:

BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Math, or a related field, or equivalent experience.
3+ years of relevant engineering experience.
Must have: Extensive knowledge of the efficiency and optimization involved in AI model execution, covering continuous batching, throughput-latency tradeoffs, KV cache and memory limitations, parallel processing techniques, MoE serving, quantization, and meeting serving SLAs.
Must have: Hands-on experience benchmarking and profiling GPU workloads using tools such as Nsight Systems, Nsight Compute, CUPTI, or PyTorch profiler, and interpreting kernel-level performance data.
Strong Python engineering skills and the ability to navigate and modify large C++/CUDA serving codebases.
Rigorous experimental methodology with controlled single-variable comparisons, reproducible benchmarks, and evidence-backed optimization decisions.
Strong written and verbal communication skills to explain performance tradeoffs clearly to both humans and documentation for autonomous systems.

Ways to stand out from the crowd:

Direct contributions to TensorRT-LLM, vLLM, SGLang, FlashInfer, Dynamo, or comparable inference frameworks.
Experience with disaggregated serving, wide expert-parallel MoE inference, KV cache transfer, or NCCL/NIXL/NVSHMEM communication at multi-node scale.
CUDA kernel authorship or optimization experience on Hopper/Blackwell architectures, focusing on Tensor Cores, TMA, and warp specialization.
Proven results on public inference benchmarks such as MLPerf Inference or SemiAnalysis InferenceX.
Experience building or operating agentic AI workflows to automate engineering tasks.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Apply About employer

Report this job