Jobs in the United States

25+ jobs

Added 2 mins ago
SS
Acquisition Program Engineer, SSC/SW
Space Systems Command
Chantilly, VA
- $102,415 to $158,322 USD / year
Join Space Systems Command as a General Engineer supporting the development and acquisition of advanced sensing capabilities that strengthen space-enabled mission outcomes. In this role,…
Added 2 mins ago
SS
AF&F ENGINEERING/PROGRAM MANAGEMENT
STRATEGIC SYSTEMS PROGRAMS (SSP)
Washington Navy Yard, DC
- $143,913 to $197,200 USD / year
You will serve as a recognized subject matter expert in AF and F Engineering, representing senior leadership in high-level technical matters. | You will lead development activities for the…
Added 3 mins ago
MT
Senior Design Verification Engineer
Micron Technology, Inc.
Minneapolis, MN
- $122,000 to $208,000 USD / year
Define and execute block and system‑level verification plans
Added 5 mins ago
NS
SUPERVISORY DISTINGUISHED ENGINEER
Naval Sea Systems Command
Port Hueneme, CA
- $198,349 to $209,600 USD / year
You will provide executive leadership and senior technical and strategic advice to command, NAVSEA, Navy, and Department of War leaders on research priorities, technology investment, fleet…
Added 5 mins ago
NA
GENERAL ENGINEER
Naval Air Systems Command
Patuxent River, MD
- $143,913 to $197,200 USD / year
You will serve as a GENERAL ENGINEER in the SYSTEMS ACQUISITION GROUP, SYSTEMS ENGINEERING DEPT, AIR PLATFORM SYSTEMS ENGINEERING DIV, and AIR PLATFORM STORES INTEGRATION BR of…
Added 7 mins ago
VH
Healthcare Engineer (Plumbing Engineer)
Veterans Health Administration
Northport, NY
- $130,369 to $169,484 USD / year
Experience: Candidates must possess one year of experience equivalent to the GS-11 grade level in the Healthcare Engineering (Plumbing Engineer) field. Qualifying GS-11 grade level…
Added 7 mins ago
UA
Interdisciplinary(MechEngrAeroEngrElecEngrOpsResAnalystMathDataSciPhySciPhysicist
U.S. Army Intelligence and Security Command
Charlottesville, VA
- $132,751 to $172,578 USD / year
…requirements to acquire vital information on foreign defense systems. | Independently evaluates complex scientific data and physical signatures utilizing computer models and simulations to…
Added 7 mins ago
Senior Design Quality Assurance - Electrophysiology
Boston Scientific
Arden Hills, MN · Arden Hills
The Senior Design Quality Assurance Engineer will bring their leadership to sustaining projects for our innovative Electrophysiology cardiovascular products portfolio. Furthermore, they…
Added 10 mins ago
Inference Performance Engineer, Agent Driven Inference Optimization
NVIDIA Corporation
Remote, United States
NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to…
Added 10 mins ago
Senior Software Engineer - Accelerated Kubernetes Runtime Team
NVIDIA Corporation
Remote, United States
…GPU-accelerated Kubernetes runtime distributions. As a Software Engineer on the Runtime team, you will design and build automation systems that enable engineers to seamlessly install,…
Added 10 mins ago
Senior Software Engineer, Kubernetes Runtime and Release
NVIDIA Corporation
Remote, United States
…release decisions across providers and GPU platforms. Develop systems to allocate GPU capacity across validation runs and account for cloud reservations and quotas. Make qualification more…
Added 14 mins ago
VH
Healthcare Engineer
Veterans Health Administration
Louisville, KY
- $58,193 to $129,225 USD / year
The position serves as a Project Engineer at an assigned Department of Veterans Affairs (VA) Healthcare System. This position performs project planning, produces designs, manages designs,…
Added 20 mins ago
MD
Interdisciplinary General Engineer/ Operations Research Analyst
Missile Defense Agency
Colorado Springs, CO · Redstone Arsenal, AL
- $91,870 to $144,102 USD / year
As a Interdisciplinary General Engineer/ Operations Research Analyst at the NH-0801/1515-3 broadband level some of your typical work assignments may include:
Added 22 mins ago
Sr. Principal System Engineer - NATO IFC Lead
CORP-Corporate Office
United States
Northrop Grumman Aeronautics Systems has an opening for a Senior Principal Systems Engineer to join our team of qualified, diverse individuals within our Systems Engineering organization,…
Added 23 mins ago
UA
ARCHITECT
U.S. Army Corps of Engineers
New York, NY
- $125,431 to $163,062 USD / year
About the Position: Position is established to serve as a District-wide expert and senior specialist in architecturaldesign. Designs generally are either prepared by other District…
Added 27 mins ago
UM
GENERAL ENGINEER
U.S. Marine Corps
Quantico, VA
- $143,913 to $197,200 USD / year
You will serve as the authoritative technical expert for the program management office lead engineer, provide business advice, anticipate operational risks, resolve unexpected events, and…
Added 28 mins ago
Principal Combustion Engineer
Reworld
FLUSHING, NY
…the Vice President, Plant Support, the Principal Combustion Engineer serves as the company's senior technical authority on Waste-to-Energy combustion performance, furnace operation, and…
Added 29 mins ago
Applications Engineer
Securitas Electronic Security, Inc
ELMSFORD, NY
…solutions and services. POSITION SUMMARY As an Applications Engineer, you will need to formulate an engineered estimate and or budget for new and existing clients that shall be provided by…
Added 29 mins ago
Senior Staff Machine Learning Engineer
Altana Technologies, Inc.
BROOKLYN, NY
…trade flowing.The Opportunity at AltanaWe're looking for a Senior Staff Machine Learning Engineer to lead the AI behind Altana Nexus, our agentic platform for global trade. You'll work on a…
Added 29 mins ago
M
Assistant Vice President, Infrastructure Engineering
MTA
Brooklyn, NY
- From $101,379 USD / year
…elevated structures, 14 under-river tubes, railway water crossing systems, subway tunnels, plants, pumps, air conditioning plants and boilers, emergency ventilation systems, emergency…
Added 30 mins ago
Principal Software Engineer - Ai
ServiceNow
Santa Clara, CA
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could…
Added 30 mins ago
Senior Project Manager Mechanical Hvac Design
Greenman-Pedersen Inc
ALBANY, NY
…hire. Visa sponsorship is typically not available for entry-level positions. GPI participates in E-Verify. Know your Right to Work. Email Communications Thank you for your interest in…
Added 30 mins ago
Senior Systems Engineer Fuel Cell Systems
Plug Power Inc.
ALBANY, NY
Senior Systems Engineer - Fuel Cell Systems Status: Exempt (Salaried) Department: Fuel Cell Platforms - Systems Engineering Position Summary Plug is building the global hydrogen ecosystem.…
Added 30 mins ago
Associate, Computer / Electrical Engineer (FPGA Development)
L3Harris
Rochester, NY
Design, analyze, modify, test and evaluate optical communications systems and subsystem level components
Added 31 mins ago
Principal Machine Learning Engineer
CVS Health
New York, NY
As the most senior engineer on the team, you will set technical direction for how machine learning is designed, built, tested, deployed, and operated at scale. You will architect the…

Inference Performance Engineer, Agent Driven Inference Optimization

Remote, United States

The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3.

Apply About employer

Applications open in a new tab.

Job details

Pay: The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3.
Apply by: May 8, 2027
Experience: 3+ years of relevant engineering experience.
Posting language: English
Posted: Nov 9, 2026

Original job description

NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to employ your optimization knowledge in an autonomous optimization framework. AI agents use this framework to repeatedly run benchmark, profile, and tune processes, amplifying the impact of every technique you design. If you enjoy extracting maximum performance from GPUs and scaling your skills beyond your individual efforts, this role is a great fit!

What you'll be doing:

Distill your performance instincts into reusable skills, workflows, and evidence-backed methodologies that AI agents can complete autonomously. Review agent-generated experiments, validate findings, and curate best-known configurations.
Performance improvement of AI inference workloads that methodically increase throughput-per-GPU and user interactivity by exploring configuration options, parallelism techniques, batching, KV cache handling, quantization, and speculative decoding settings.
Measure and optimize both aggregated and disaggregated serving architectures across TensorRT-LLM, SGLang, vLLM, and Dynamo on NVIDIA's latest GPU platforms.
Profile workloads using Nsight Systems, kernel traces, and internal analysis tools. Use roofline and speed-of-light analysis to find credible headroom and drive fixes from hypothesis to measured wins.
Land improvements upstream: serving framework patches, optimized kernels, and deployment recipes that advance the public Pareto frontier while maintaining strict model correctness.
Collaborate with TensorRT-LLM, SGLang, vLLM, kernel, benchmarking, and GPU architecture teams to convert profiling insights into delivered performance improvements.

What we need to see:

BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Math, or a related field, or equivalent experience.
3+ years of relevant engineering experience.
Must have: Extensive knowledge of the efficiency and optimization involved in AI model execution, covering continuous batching, throughput-latency tradeoffs, KV cache and memory limitations, parallel processing techniques, MoE serving, quantization, and meeting serving SLAs.
Must have: Hands-on experience benchmarking and profiling GPU workloads using tools such as Nsight Systems, Nsight Compute, CUPTI, or PyTorch profiler, and interpreting kernel-level performance data.
Strong Python engineering skills and the ability to navigate and modify large C++/CUDA serving codebases.
Rigorous experimental methodology with controlled single-variable comparisons, reproducible benchmarks, and evidence-backed optimization decisions.
Strong written and verbal communication skills to explain performance tradeoffs clearly to both humans and documentation for autonomous systems.

Ways to stand out from the crowd:

Direct contributions to TensorRT-LLM, vLLM, SGLang, FlashInfer, Dynamo, or comparable inference frameworks.
Experience with disaggregated serving, wide expert-parallel MoE inference, KV cache transfer, or NCCL/NIXL/NVSHMEM communication at multi-node scale.
CUDA kernel authorship or optimization experience on Hopper/Blackwell architectures, focusing on Tensor Cores, TMA, and warp specialization.
Proven results on public inference benchmarks such as MLPerf Inference or SemiAnalysis InferenceX.
Experience building or operating agentic AI workflows to automate engineering tasks.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 124,000 USD – 195,500 USD for Level 2; and 152,000 USD – 241,500 USD for Level 3. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Apply About employer

Report this job