Remote jobs in the United States

25+ jobs

Save this search

Added 35 mins ago
ET
AI Infrastructure Specialist
EdgeQ Technologies Private Limited
Remote, United States
- $95,000 to $155,000 USD / year
Experience with NVIDIA GPUs, CUDA, and GPU resource management.
Added 1 day ago
Mojo Libraries Engineer
Modular
Remote, United States
Hands-on experience with at least one heterogeneous programming model (CUDA, SYCL, OpenCL, or similar), either as a user or contributor
Added 1 day ago
BN
Applied AI/ML Engineer
Boundless Networks, Inc.
Remote, United States
- $175,000 to $250,000 USD / year
Working understanding of GPU execution: batching, memory, and basic CUDA concepts
Added 1 day ago
BN
Senior Infrastructure Engineer - GPU Compute
Boundless Networks, Inc.
Remote, United States
- $175,000 to $250,000 USD / year
Bare-Metal & GPU Optimization: Go deep on GPU performance - PCIe P2P, ReBAR, NUMA topology (e.g. EPYC SP5), CUDA/driver tuning, memory configuration, and network topology - to push…
Added 1 day ago
AI Developer
Salvo Software
Remote, United States
…growing our AI department and are looking for a hands-on AI Developer to help build…
Added 1 day ago
Expert RAG Engineer
Salvo Software
Remote, United States
Optimize LLM serving with Ollama and llama.cpp: quantization (GGUF), GPU/CUDA tuning, batching, caching, and offline/air-gapped deployments.
Added 1 day ago
Principal Engineer, Model Performance
Runware
Remote, United States
Do the hardest work yourself: write and tune CUDA kernels, fuse attention and MLP paths, bring up new quantization formats (FP8, FP4, INT4) with quality held, and get new parallelism and…
Added 3 days ago
RU
Technical Lead - Simulation Engineer
Randstad USA
Remote, United States
- $70 to $110 USD / hour
…harnesses). Physics and rendering simulation (Omniverse RTX, PhysX, CUDA, synthetic sensor modeling for Camera/LiDAR/Radar). Automated testing and verification. Platform runtimes and SDK…
Added 4 days ago
Senior Software Engineer, World Model - Autonomous Vehicles
NVIDIA USA
Remote, United States
Use GPU parallelism (CUDA) where it helps to accelerate compute-heavy mapping components.
Added 4 days ago
Performance & Debug Software Engineer – AI Inference
Positron AI
Remote, United States
Experience with CUDA, HIP, Triton, GPU kernel development, distributed inference, or KV cache systems.
Added 5 days ago
Senior Software Engineer - CUDA
Snarkify
Remote, United States
Proficient in GPU programming languages such as CUDA.
Added 6 days ago
RU
Lead Software Engineer
Randstad USA
Remote, United States
- $70 to $100 USD / hour
Code Refactoring & Tuning: Refactor and tune CUDA, C++, and Python simulation code to maximize hardware utilization, throughput, and execution speed.
Added 6 days ago
Senior Compiler Engineer - AI
NVIDIA USA
Remote, United States
Knowledge of GPU communication libraries such as NCCL, NVSHMEM, or RDMA, and of CPU and/or GPU architecture. CUDA programming experience is a plus.
Added 6 days ago
Quantum Research Scientist
MANTECH
Remote, United States
Professional certifications such as IBM Certified Quantum Computation using Qiskit Developer, MIT xPro Quantum Computing Fundamentals, or Advanced HPC/GPU Acceleration (e.g., NVIDIA CUDA).
Added 7 days ago
Senior Compiler Engineer, Agentic Compiler Systems
NVIDIA USA
Remote, United States
In this role, you will help design and build advanced compiler and verification systems that improve developer productivity, system performance, and confidence in correctness. This includes…
Added 7 days ago
Linux Infrastructure Engineer (Bare Metal, Storage & AI Factory Infrastructure)
Uvation
Remote, United States
Added 10 days ago
DC
Senior Engineer - ML Operations
Danaher Corporation
Remote, United States
- $180,000 to $220,000 USD / year
…management, LLM provider/gateway routing and rate limits, and driver/CUDA image hygiene, partnering with the platform team to maximize value from contended, high-demand…
Added 11 days ago
Senior Software Engineer, AI Frameworks
NVIDIA USA
Remote, United States
…deliver robust integrations, reference implementations, and developer-focused…
Added 11 days ago
M
Perception Engineer
Motional
Remote, United States
- $165,000 to $197,698 USD / year
Added 11 days ago
Scientific Developer for Model Optimization
Lynker Corporation
Remote, United States
…expansion, we are seeking a dynamic and experienced Scientific Developer for Model Optimization to join our growing…
Added 12 days ago
Sr. Principal Engineer - Vision Intelligence
Oshkosh Corporation
Remote, United States
Experience with modern AI/ML frameworks and tools such as PyTorch, TensorFlow, ONNX, OpenCV, CUDA, TensorRT, or equivalent.
Added 12 days ago
Software Engineer - Kernels
MatX
Remote, United States
- Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
Added 13 days ago
Staff/ Principal Software Engineer (L6/L7): AI Platform Model Serving
Netflix, Inc.
Remote, United States
…repurposed to run open-weight models for internal coding and developer productivity use…
Added 13 days ago
Solutions Architect, AI/ML
Fidus Systems
Remote, United States
Added 13 days ago
Senior Solutions Architect, Telco
NVIDIA USA
Remote, United States
8+ years of professional experience in Industry background spanning software/hardware engineering, developer relations, technical partnerships, solutions architecture, or product management…

Closed listing

Venice.ai

Engineering Lead, Inference Optimization

Remote, United States

This opening has closed.

The original listing is kept below for reference.

Find open jobs More jobs with this employer

About employer

Job details

Experience: 5+ years experience leading engineering teams
Posting language: English
Posted: Aug 19, 2026

Similar jobs hiring now

Search current openings

Original job description

Archived listing. The details below describe a past opening.

About Us

Venice is the world’s leading consumer AI company built on principles of privacy, free speech, and user sovereignty.

We’re building the Port City of AI, in which millions of individuals, third party apps, and AI agents gather, interact, and access sophisticated AI resources on a private and permissive foundation. Our mission is to make artificial intelligence approachable and useful in everyday work - bridging the gap between cutting-edge research and practical, real-world impact.

We’re a fast-moving startup where every team member is expected to make a clear impact. Our culture is rooted in curiosity, ownership, ethical principle, philosophy, and collaboration - whether we’re designing better AI workflows, supporting our growing community, or shaping the future of human-AI interaction.

Joining Venice AI means joining a team of unorthodox builders who believe in moving quickly, delivering a beautiful mass-marketand highly useful consumer product that doesn’t spy on people or censor their ideas and questions., and maintaining an edge in the rapidly evolving world of agentic machine intelligence. If you’re energized by big ideas, entrepreneurial spirit, individual empowerment, and the opportunity to help shape a fast-growing company in the world’s hottest industry from the ground up, please reach out.you’ll feel right at home here.

Why we are hiring

Venice is the only AI platform that runs inference with zero data retention and zero training on user inputs. This is an opportunity for you to be on the bleeding edge of privacy-focused AI with a unique and dedicated team of high-agency individuals alongside you. This role requires both hands on work as an individual contributor as well as the management of a small team. You will play a pivotal role, shaping Venice's overarching technical strategy and assembling an exceptional team to deliver peak inference performance at massive scale.

What you'll do

Own Venice’s technical strategy for inference performance
Recruit and lead the Inference Optimization Team at Venice
Optimize Venice's GPU infrastructure across a range of architectures (e.g. H200s, B300s)
Improve latency, throughput, and cost per token for LLM inference workloads
Build reproducible benchmarking harnesses across inference engines (e.g. vLLM, SGLang) to identify the optimal engine, quantization scheme, and parallelism strategy per workload and GPU SKU
Work with our inference routing system to optimize multivariate inference load-balancing algorithms
Evaluate emerging inference optimization techniques (custom CUDA/Triton kernels), novel attention variants, new quantization schemes, and compilation stack improvements. Hands-on kernel development experience is a strong plus.
Evaluate emerging inference hardware (FPGAs, ASICs, custom silicon) for viability in Venice's stack.

Who you are

8+ years in performance optimization or HPC, with deep GPU architecture and parallel programming knowledge
5+ years experience leading engineering teams
Proficiency in Python, Rust, or Go.
Bonus: C++/CUDA
Hands-on experience with at least one production LLM inference engine (e.g. vLLM, SGLang) running at high volume in production
Demonstrated experience with LLM inference optimization techniques: continuous batching, PagedAttention/KV cache management, speculative decoding, quantization, CUDA graphs, and torch.compile
Fluency with quantization tradeoffs, both qualitative and quantitative
Experience with distributed inference strategies (tensor parallelism, pipeline parallelism, MoE parallelism) in multi-GPU and multi-node environments
Fluency with GPU profiling (Nsight Systems, Nsight Compute, PyTorch Profiler) and a bias toward measuring before optimizing
Bonus: diffusion/image model inference optimization, custom Triton kernels, contributions to open-source inference frameworks

About employer

More about this job

Skills

Python
Rust
Go
C++
PyTorch

Report this job