Jobs in the United States

25+ jobs

Save this search

Added 5 mins ago
RT
CHIEF ENGINEER
RAINMAKER TEAM LLC
Lexington, KY
- $18 to $20 USD / hour
The Chief Engineer is responsible for overseeing the maintenance, repair, and overall physical condition of the hotel property. This position ensures that all building systems, guest rooms,…
Added 6 mins ago
Senior Fire Protection Engineer
Amentum
Richland, WA
In this role, you will integrate safety and health requirements into complex project planning, and operations to reduce the potential for adverse impacts. You will perform risk assessments,…
Added 6 mins ago
Plant Engineer 1 – Melter and Offgas Systems
Amentum
Richland, WA
The Plant Engineer is responsible for technical activities relating to operations and maintenance of plant equipment during Engineering, Commissioning, and Operations. The Melter and Offgas…
Added 7 mins ago
Software Development Manager, Management Plane
Amazon
Seattle, WA
Added 7 mins ago
ConvergeCONSUMER - Technical Software Engineering Lead (Manager) - Products & Platforms
Deloitte
Seattle, WA
Are you an experienced Software Engineer who has led the development of world-class software or digital products? Are you looking for an opportunity to expand your scope and lead products…
Added 7 mins ago
ConvergeProsperity - Lead Product Forward Deployed Engineer for FSI Signals - Products & Platforms
Deloitte
Seattle, WA
Are you energized by both winning the deal and delivering on it? As a Product Forward Deployed Engineer (pFDE), you'll be the GTM & Delivery engine for Signals, a priority product in the…
Added 7 mins ago
Software Engineer III - Full-stack Developer with Anthropic Experience
Deloitte
Seattle, WA
Software Engineer III with Agentic AI Experience, AI & Engineering/Engineering as a Service
Added 7 mins ago
Signals for FSI - Product Forward Deployed Engineer - Innovation_Delivery_Transformation
Deloitte
Seattle, WA
Are you energized by both winning the deal and delivering on it? As a Product Forward Deployed Engineer (pFDE), you'll be the GTM & Delivery engine for Signals, a priority product in the…
Added 7 mins ago
Software Development Manager , AWS DynamoDB
Amazon
Seattle, WA
1+ years of providing technical leadership and project management for all aspects of the software development lifecycle experience
Added 11 mins ago
Senior Industrial Engineer
Executive Recruiting Group
Westminster, MD
…Engineers and Setup Technicians, ensuring technical direction, project execution,…
Added 14 mins ago
Senior Equipment Engineer, AMZL
Amazon.com Services LLC
Nashville, TN · Bellevue, WA
The WW Equipment Engineering Innovation team is searching for an innovative and solutions-oriented engineer to lead the initiative of developing and delivering current and next generation…
Added 47 mins ago
EI
Lead Engineer, Product Development Engineering
Entegris, Inc.
Colorado Springs, CO
- $31,533 USD / year
We areseekinga talented and driven Product Development Engineer to join our team to design and launch next generation MicroEnvironments products - critical technologies enabling the safe…
Added 59 mins ago
H
Software Systems Engineer - GitHub Enterprise
HP
Vancouver, WA
- $105,050 to $161,800 USD / year
…intersection of software development, system architecture, and project management to ensure the successful development and deployment of software solutions that address a wide range of…
Added 1 hour ago
Electrical Field Engineer - Kiewit Power Constructors
Kiewit
Lenexa, KS
As an Electrical Construction Field Engineer, you will be the primary electrical engineering lead on the EPC project; you will be expected to be a job-site leader in health and safety,…
Added 1 hour ago
SC
Transportation Engineer
Stanley Consultants
Denver, CO
- $40,123 USD / year
We are seeking a talented Transportation Engineer to join our Denver office. This role offers the opportunity to design complex transportation design projects while contributing to…
Added 1 hour ago
SC
Principal Control Systems Engineer
Stanley Consultants
Denver, CO
- $40,123 USD / year
Job title - Principal Control Systems Engineer
Added 1 hour ago
Mechanical Engineer
Precision Castparts Corp.
NEW HARTFORD, NY
…preparation of specifications and bid packages. * Responsible for project supervision during installation and startup of approved projects. * Responsible for project follow-up including…
Added 1 hour ago
Summer 2027 Intern Process Engineer (Melt)
ATI Metals
LOCKPORT, NY
…Engineering, Metallurgical Engineering, or a related technical field. The intern will assist with process improvement projects, production support, data analysis, troubleshooting, and…
Added 1 hour ago
Radio Frequency Engineer
STI-CO Industries, Inc.
ORCHARD PARK, NY
…VSWR optimization, and miniaturization techniques. Executing project design concepts effectively to fulfill customer and internal requirements within a predetermined schedule and budget.…
Added 1 hour ago
Engineer Facilities Engineering UPW/W/WWT
GlobalFoundries
ROUND LAKE, NY
Added 1 hour ago
Senior Geotechnical Engineer
Tectonic Engineering & Surveying Consultants, PC
NEWBURGH, NY
Position: Senior Geotechnical Engineer Location:Newburgh, NYRemote Status: Hybrid Job Id: 1597-2026 # of Openings: 1 Tectonic's Geotechnical Team based in Orange County, NY is currently…
Added 1 hour ago
Engineer Substation
Avangrid Service Co
BINGHAMTON, NY
Engineer - Substations Location: Rochester, Binghamton, Brewster or Mechanicville, NY Reports to: Manager - Projects Unit Work Type: Office, 5 Days The salary range for this position is…
Added 1 hour ago
Engineer Protection & Control
Avangrid Service Co
BINGHAMTON, NY
Job Title: Engineer - Protection & Control Reports to Manager, Unit Projects Reports in office to: Binghamton, NY The salary range for this position is based on experience level ranging…
Added 1 hour ago
KT
Project Manager Facades Engineering
KCI Technologies, Inc.
ALBANY, NY
- $42.49 to $69.93 USD / hour
Project Manager - Facades EngineeringJob LocationsUS-PA-Allentown | US-NJ-Woodcliff | US-NY-New York | US-NY-Albany | US-MD-BaltimoreID2026-8107CategoryProject ManagementTypeFull-Time…
Added 1 hour ago
Engineer Substation
Avangrid Service Co
ROCHESTER, NY

Rhoda AI

Senior Inference Optimization ML Engineer

Mountain View,, CA, United States

Apply About employer

Applications open in a new tab.

Job details

Experience: 2+ years of experience in inference optimization, ML systems, ML compilers, or a closely related field.
Posting language: English
Posted: Nov 1, 2026

Original job description

At Rhoda AI, we’re building the next generation of generalist intelligent robots. We own the full robotics stack from high-performance hardware and robot systems to the infrastructure and state-of-the-art foundation world models that control our robots. Our robots are designed to be generalists capable of operating in complex, real-world environments and handling long-tail edge cases, made possible by our cutting edge research and end-to-end system design. We've raised over $450M and are investing aggressively in model research, infrastructure, hardware development, and manufacturing scale-up to make generalist robotics a reality.

Running large multimodal foundation models for a growing fleet of robots is expensive. We can't rely on one hardware vendor or the most expensive accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast, correctly, and cheaply on a wide range of hardware: AMD Instinct GPUs, Google TPUs, wafer-scale and dataflow accelerators, consumer GPUs like the RTX 5090, and the Jetson/Thor-class compute on our robots. You'll decide which chip runs which workload, and then make sure it runs well there. You'll work closely with the research, robotics, and infrastructure teams.

WHAT YOU'LL DO

Own cost-efficient inference end-to-end. Make Rhoda's foundation models (vision, video, language, proprioception, action) faster and cheaper to run, measured in latency, throughput, and cost per inference.
Port and optimize models for non-NVIDIA and lower-cost hardware. This includes AMD (ROCm, HIP, MIOpen/hipBLASLt, Composable Kernel), TPU (XLA, JAX, Pallas, PyTorch/XLA), wafer-scale and dataflow accelerators (their SDKs and compilers), and consumer Blackwell GPUs such as the RTX 5090 (FP8/FP4, small memory, multi-GPU setups over PCIe).
Own on-robot inference. Deploy and optimize models on Jetson/Thor-class embedded compute under tight latency, power, thermal, and memory limits, and decide how work is split between the robot and the cloud to meet real-time control requirements.
Evaluate hardware rigorously. Build cost/performance models (perf/$, perf/W, memory capacity and bandwidth, interconnect) for each chip and model family. Write clear recommendations on which hardware to buy or rent for serving, offline evaluation, and on-robot use.
Build hardware-portable optimizations. Write and tune kernels that work across vendors where possible (Triton, Pallas, MLIR-based compilers) and vendor-specific ones where the speedup justifies it. Handle attention, KV cache, memory layout, and fused operators on every backend.
Apply model compression for constrained hardware. Use quantization (INT8, FP8, FP4/MX formats, AWQ/GPTQ), pruning, distillation, and model or tensor parallelism so models fit and perform well on chips with less memory or limited data-type support.
Keep results correct and consistent across backends. Build tests that check numerical parity, policy quality, and robot-relevant behaviour, so a model gives the same results whichever chip it runs on.
Build benchmarking and regression infrastructure across hardware. Track latency baselines, throughput curves, and cost per inference for every model version on every target, with automated detection of regressions.
Work with research engineers to design models that stay efficient and portable from the start, for example by avoiding operators that only exist on one vendor's hardware.

WHAT WE'RE LOOKING FOR

2+ years of experience in inference optimization, ML systems, ML compilers, or a closely related field.
Deep hands-on experience with PyTorch.
Strong understanding of compute, memory bandwidth, memory capacity, and interconnect bottlenecks, and how they change from one hardware architecture to another.
Experience with model optimization techniques: quantization (INT8/FP8/FP4, AWQ), distillation, pruning, and compilation (torch.compile, XLA, TensorRT, IREE/MLIR, TVM, or vendor compilers).
Familiarity with inference serving frameworks and their support for different hardware (e.g. vLLM on ROCm/TPU, SGLang, JetStream, Triton Inference Server).
Excellent debugging and measurement skills. You can take "this is slow on chip X" or "this costs too much" and turn it into clear bottlenecks, experiments, and validated improvements.
A high-ownership, pragmatic mindset. You care about the total cost of a solution, not just peak benchmark numbers.

NICE TO HAVE (BUT NOT REQUIRED)

Experience optimizing inference for diffusion models.
Production or deep project experience with at least one accelerator stack other than NVIDIA datacenter GPUs: AMD ROCm, Google TPU, wafer-scale and dataflow accelerators, Groq, Tenstorrent, AWS Trainium/Inferentia, Intel Gaudi, or similar, or serious work deploying on consumer GPUs.
Kernel authoring on more than one backend: HIP or Composable Kernel on AMD, Pallas on TPU, Triton on both NVIDIA and AMD, CUTLASS/CuTe.
Contributions to open-source ML compilers or hardware backends (PyTorch, OpenXLA, Triton, vLLM, IREE, TVM).
Experience running inference on wafer-scale systems, TPU pods, or fleets of consumer GPUs.
Hands-on experience with Jetson/Thor-class platforms (TensorRT on Jetson, JetPack, DLA, power and thermal profiling).
Experience with multimodal or video model inference (variable-length sequences, packing/bucketing).
Speculative decoding, continuous batching, disaggregated prefill/decode, or other LLM serving optimizations.
Experience with streaming or low-latency systems for real-time robot control.
Experience working with hardware vendors on driver or compiler bugs and early-access silicon.

WHY THIS ROLE

Direct impact on cost and scale. Every gain in perf/$ you deliver lowers the cost of serving models and evaluating new ones, and of putting capable models on many more robots.
Strategic influence over hardware. Your benchmarks and recommendations will directly shape which accelerators Rhoda buys and builds on, in the cloud and on the robot.
High ownership on a small, elite team. You'll own the optimization layer that decides how fast and how cheaply our foundation models run in the real world, on every target we use.

Apply About employer

Report this job