Jobs in the United States

25+ jobs

Save this search

Added 3 mins ago
OS
Senior Modeling and Simulation Engineer
Oasis Systems LLC
Bedford, MA
- $145,000 to $150,000 USD / year
Astrion has an exciting opportunity fora Senior Modeling and Simulation Engineer located at theHanscom AFB inBedford, MA. This role is in the C3I and Infrastructure Division (AFLCMC/HNI)…
Added 4 mins ago
Director, Electronic Warfare Engineering
L3Harris Technologies
Clifton, NJ
Demonstrated technical leadership on large, complex programs (e.g., project engineer or technical lead).
Added 7 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Cleveland, OH
- $129,000 to $150,000 USD / year
An established MEP consulting engineering firm in Cleveland, OH is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on healthcare,…
Added 7 mins ago
G
Senior Structural Engineer / Project Manager
GPAC
Chicago, IL
- $130,000 to $165,000 USD / year
A well-established structural engineering firm in the Naperville area is hiring a Senior Engineer / Project Manager. An upcoming retirement makes this a priority hire. The firm has been in…
Added 7 mins ago
G
Senior Mechanical Engineer, PE
GPAC
Cincinnati, OH
- $129,000 to $150,000 USD / year
An established MEP consulting engineering firm in Cincinnati, OH is adding a Senior Mechanical Engineer to its building systems team. You'll lead HVAC and plumbing design on healthcare,…
Added 7 mins ago
G
Staff Structural Engineer
GPAC
Chicago, IL
- $90,000 to $125,000 USD / year
A well-established structural engineering firm in the Naperville area is hiring a Staff Engineer. You'll work on concrete, steel, masonry, and wood buildings across the commercial,…
Added 8 mins ago
Senior Electrical Engineer (Generation)
WSP
Meridian, ID · Seattle, WA · Houston, TX · Mount Laurel, NJ · Oradell, NJ · Atlanta, GA · Overland Park, KS · Tulsa, OK · Phoenix, AZ · Boise, ID · Hailey, ID
WSP is currently initiating a search for a Senior Electrical Engineer (Generation) to join our Power & Energy team. This is a nationwide search and any WSP office will be considered, with…
Added 10 mins ago
Administration Director, Facilities Management
Coke Florida
Tampa, FL
Serve as the senior escalation point for critical facility issues, infrastructure events, and operational disruptions.
Added 11 mins ago
TA
SPACE NORTH Theater Support Lead
The Aerospace Corpor
Colorado Springs, CO
- $151,300 to $226,900 USD / year
What You Need to be Successful - Senior Project Engineer
Added 11 mins ago
TA
Space Vehicle and Electronic Component Structural Engineer
The Aerospace Corpor
Colorado Springs, CO
- $117,300 to $226,900 USD / year
…well-qualified Space Vehicle and Electronic Component Structural Engineer (Engineering Specialist/ Senior Engineering Specialist - Aeronautical and Aerospace Structural Engineering), with a…
Added 12 mins ago
Principal Engineer, Model Performance
Runware
Remote, United States
As Principal Engineer, Model Performance, you will own how fast and how cheaply every model on Runware runs: diffusion and video generation, speech, 3D and LLMs, across 400,000+ models and…
Added 21 mins ago
G
Sr. Electrical Engineer/Project Manager
GPAC
Columbus, OH
- $95,000 to $155,000 USD / year
A reputable and established multi-disciplinary Engineering firm is looking for a Senior Electrical Engineer/Project Manager, with a passion to deliver excellence! This firm works hard to…
Added 29 mins ago
G
Engineer-Civil-P.E. - Wichita, KS
GPAC
Wichita, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Topeka, KS
GPAC
Topeka, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Lawrence, KS
GPAC
Lawrence, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Manhattan, KS
GPAC
Manhattan, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Salina, KS
GPAC
Salina, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Hutchinson, KS
GPAC
Hutchinson, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Hays, KS
GPAC
Hays, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Great Bend, KS
GPAC
Great Bend, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Pratt, KS
GPAC
Pratt, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Dodge City, KS
GPAC
Dodge City, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Garden City, KS
GPAC
Garden City, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 29 mins ago
G
Engineer-Civil-P.E. - Liberal, KS
GPAC
Liberal, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…
Added 30 mins ago
G
Engineer-Civil-P.E. - Colby, KS
GPAC
Colby, KS
- $100,000 to $165,000 USD / year
We are seeking an experienced Professional Engineer (PE) to join our Land Development team in a Project Manager capacity. This individual will play a key role in leading projects, managing…

Runware

Principal Engineer, Model Performance

Remote, United States

Apply About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Nov 6, 2026

Original job description

Runware is the AI inference platform that builds and runs its own infrastructure, end to end. Our Sonic Inference Engine has served more than 20 billion requests for over 1 million developers and 500 million end users, with 400,000+ models behind a single integration, at up to 10x lower cost per token than traditional providers. We are now building the AI Factory that runs it. The Sonic Inference Pod packs 1 MW of custom-designed compute into a 20-foot container with closed-loop, water-free cooling, sited wherever power exists. Pods are live in the US and Europe, and we are scaling to dozens of pods and tens of thousands of GPUs, all operated as one distributed fabric that reroutes traffic the moment a pod goes offline (announcement). Every request that hits that fleet, whether it is an image, a video, a voice or a token stream, has to come back faster and cheaper than anyone else can serve it. Model performance is what makes that true. That is the job. The role As Principal Engineer, Model Performance, you will own how fast and how cheaply every model on Runware runs: diffusion and video generation, speech, 3D and LLMs, across 400,000+ models and tens of thousands of GPUs. You will set the performance roadmap, build the hardest pieces with your own hands, and build and lead the Model Performance team as it grows around you. This is a principal-level role for someone who has led inference performance work at the frontier and still writes the kernel. You will decide where the next 2x comes from on a given model and hardware generation, whether that is a fused attention kernel, a better quantization recipe, speculative decoding, a smarter batching policy or a different parallelism layout, and then make it land in production on real traffic. You will work directly with the Sonic Inference Engine team, the infrastructure and hardware teams, and with NVIDIA and the open-source engine communities, and you will hire, mentor and lead the engineers who do this work alongside you. Success means Runware serves a new open model at the Pareto frontier of latency and cost within days of its weights being released, our cost per request keeps falling with every hardware generation, and the team you have built can do this without you in the loop. What you'll do

Own inference performance end to end for the fleet: the kernels, the serving engines, the model-level optimizations and the benchmarks that prove them, across image, video, audio, 3D and LLM workloads on every GPU generation we run.
Set the model performance roadmap. Decide which models, hardware and techniques get the team's attention and in what order, based on real traffic, real cost and what the next generation of pods will run.
Do the hardest work yourself: write and tune CUDA kernels, fuse attention and MLP paths, bring up new quantization formats (FP8, FP4, INT4) with quality held, and get new parallelism and batching strategies working on multi-GPU nodes.
Make new models fast on day one. Build the pipeline that takes a newly released open model from weights to a production-grade, optimized deployment in days, and keep closing that gap.
Choose and shape the serving stack: TensorRT-LLM, vLLM, SGLang, custom diffusion and video pipelines, and the Sonic Inference Engine's own runtime. Decide what we adopt, what we fork and what we write ourselves, and contribute upstream where it pays.
Own the benchmarking and performance regression system: reproducible, hardware-aware measurement of throughput, latency, cost and quality for every model we serve, wired into CI so that a regression never reaches a pod.
Partner with infrastructure and hardware engineering on GPU memory, storage and network bottlenecks that show up as inference latency, and feed what you learn back into the next generation of servers and pods.
Build and lead the team. Hire principal and senior engineers, set the bar for technical rigour, mentor the people on the team, and run it so that a very small group delivers performance across a very large model catalogue.
Use AI to accelerate the work: automated kernel search and tuning, benchmark generation, profiling triage and documentation with LLM-based agents, so that the team's output grows faster than its headcount.

Requirements

What we're looking for

10+ years in GPU, HPC or deep learning systems engineering, with several of those optimizing inference performance for models in production at a company that runs them at scale.
A track record of shipping performance, not just measuring it. You have taken a state-of-the-art model from a reference implementation to the Pareto frontier of latency and cost on real hardware, and you know what breaks between the two.
Deep, current, hands-on CUDA and GPU architecture expertise: kernel design, memory hierarchy and occupancy, Tensor Cores, fused kernels, CUDA Graphs, NCCL, and the profilers (Nsight Systems and Compute) that show exactly where a microsecond goes.
Real production experience with at least one major inference engine (TensorRT-LLM, vLLM, SGLang or similar) and with the techniques that define modern serving: continuous batching, paged KV cache, speculative decoding, prefill/decode disaggregation, quantization and tensor, pipeline and expert parallelism.
Fluent in Python and C++, comfortable in PyTorch internals, torch.compile and Triton, and happy to write the benchmark, the kernel and the CI job yourself rather than waiting for someone else to.
Experience leading engineers: you have built or run a performance team, hired for it, set its technical direction and stayed hands-on while doing so.
You use AI to accelerate your own output every day, for kernel search, profiling analysis, benchmarking, documentation and code review, and you have a clear view of how a small team armed with these tools should operate differently.
Comfortable owning outcomes in a fast-moving, ambiguous environment, making decisions with incomplete information and being accountable for latency, cost and quality across hundreds of thousands of models.

Nice to have

Diffusion and video generation performance: DiT and UNet pipelines, attention at long sequence lengths, step distillation, caching across denoising steps, LoRA hot-swapping, and the loaders and samplers in ComfyUI, Diffusers or custom engines.
Contributions to TensorRT-LLM, vLLM, SGLang, FlashAttention, CUTLASS, Triton, Dynamo or similar open-source inference projects, or an open-source project of your own that people run.
Experience with Blackwell-generation hardware (B200, GB200/GB300 NVL72), NVLink and NVSwitch topologies, and multi-node inference over InfiniBand or RoCE.
Mixture-of-experts serving: expert parallelism, expert placement and load balancing, and the memory and communication trade-offs that come with them.
Accuracy evaluation for optimized models: the harnesses, datasets and statistical discipline to prove a quantized or distilled model is as good as the original.
Experience with non-NVIDIA accelerators (AMD, TPU or custom silicon) and with porting an inference stack across them.
Speech and audio model serving: streaming ASR and TTS with tight latency budgets.
Published work, patents or talks on inference performance.

Benefits

What we offer

A rare mandate: own inference performance for one of the largest model catalogues in the world, on hardware the company designs and operates itself, at a business whose margin is your work, with the GPU budget and backing to match.
Meaningful stock options.
We're a remote-first collective, meeting in person twice a year to plan, brainstorm and celebrate wins. We keep core hours for collaboration and calls; outside those, you set your own schedule.
Our release cycles are fast and intense, and they're followed by real downtime. We expect you to take it.
Generous paid time off, including vacation, sick days and public holidays.
Paid maternity, paternity and caregiver leave.
Twice-yearly company retreats in inspiring locations.

Apply About employer

Report this job