Jobs in the United States

25+ jobs

Save this search

Added 26 mins ago
Senior Network Security Engineer
Applied Materials
Santa Clara, CA · Santa Clara
We are seeking a Senior Network Security Engineer with deep expertise in enterprise firewall architecture and engineering to design, implement, secure, and continuously improve Applied…
Added 55 mins ago
Senior Network Security Engineer
Applied Materials, Inc
Santa Clara, CA
We are seeking a Senior Network Security Engineer with deep expertise in enterprise firewall architecture and engineering to design, implement, secure, and continuously improve Applied…
Added 1 hour ago
H&
Principal Machine Learning Engineer
Hims & Hers
Remote, United States
- $180,000 to $200,000 USD / year
- A Master’s degree or PhD in Computer Science, Machine Learning, or a related field (not strictly required)
Added 3 hours ago
Director, Principal Platform Architect
Charles Schwab
Austin, TX
We are seeking a Director, Principal Platform Architect to help shape the future of resilient, scalable, and intelligent enterprise platforms. This senior individual-contributor role…
Added 3 hours ago
Lead Architect, AI Solutions - EDDA
Travelers Indemnity Co
Hartford, CT · Atlanta, GA · St. Paul, MN · Hunt Valley, MD
As a Lead Architect, you will collaborate with senior Technology and Business leaders and apply your deep technical proficiency and visionary thinking to architect AI systems that drive…
Added 4 hours ago
AI Native Senior Software Engineer
Versaterm
Remote, United States
The AI Native Senior Software Engineer is a change agent and a driver of value within our public safety ecosystem. Public safety agencies, dispatchers, and first responders count on our…
Added 4 hours ago
AI Native Senior Software Engineer
Versaterm
Mesa, AZ
The AI Native Senior Software Engineer is a change agent and a driver of value within our public safety ecosystem. Public safety agencies, dispatchers, and first responders count on our…
Added 4 hours ago
Senior Microsoft Power Platform Developer (5830)
SMX
United States
SMX is actively seeking a highly skilled, strategic, and collaborative Senior Microsoft Power Platform Developer to join our team. In this role, you will support a critical federal customer…
Added 4 hours ago
Architect, Ontology & AI Innovation
Kinaxis Inc.
Remote, United States
The AI team is responsible for advancing machine learning solutions in the supply and demand space across industries such as Retail, Consumer Packaged Goods, and Life Sciences. Our work…
Added 5 hours ago
VH
Senior Data Scientist
Versant Health
Troy, NY
- $170,000 to $180,000 USD / year
The Senior Data Scientist is a principal‑level individual contributor responsible for architecting, delivering, and governing enterprise‑grade advanced analytics and machine learning…
Added 5 hours ago
U
Sr Software Engineer - Matching Platform
Uber
San Francisco, CA · Seattle, WA · Sunnyvale, CA
- $202,000 to $224,000 USD / year
…routing, combinatorial optimization, and production machine learning infrastructure. As a Senior Software Engineer, you will design the foundation for our next-generation dispatch and…
Added 5 hours ago
SO
Senior Analytics Engineer
System One
Boston, MA
- $68 to $73.33 USD / hour
The Senior Analytics Engineer leads the design and development of the analytics data architecture, semantic models, and data pipelines that power reporting, analytics, and AI-enabled…
Added 5 hours ago
O
Lead Principal Systems Software Engineer
Oracle
United States
- $146,300 to $306,400 USD / year
Be the senior technical engineer and hands-on architect for the Cloud Infrastructure and Services platform, spanning physical provisioning, virtualization, Kubernetes and platform services.…
Added 6 hours ago
EH
Senior AI Engineer
Ellipsis Health
San Francisco, CA
- $160,000 to $210,000 USD / year
- Hands-on experience with machine learning or deep learning frameworks (e.g., PyTorch, JAX, or TensorFlow).
Added 6 hours ago
MC
Global Cybersecurity Principal Domain Architect - AI and Data Analytics
McDonald's Corporation
Chicago, IL
- $168,350 to $218,860 USD / year
The Global Cybersecurity Principal Domain Architect – AI and Data Analytics will serve as a technical authority for the Artificial Intelligence and Data Analytics cybersecurity…
Added 6 hours ago
P
Data Architect
PACCAR
Renton, WA
- $132,000 to $213,500 USD / year
…initiatives, and influences executive decision-making through deep expertise and strategic vision. The role acts as a trusted advisor to senior leadership and is responsible for developing…
Added 7 hours ago
Senior Research Engineer
Google
New York, NY
Train, evaluate, and iterate on deep neural models and reinforcement learning algorithms to continually improve agent performance and achieve research objectives.
Added 8 hours ago
FE
Data Engineer Principal (Enterprise Data Group)
Federal Express Corporation
Memphis, TN · Plano, TX · Moon Township, PA
- $11,177.95 to $15,884.45 USD / month
The Data Engineering Principal serves as the senior technical authority and architect across enterprise data engineering initiatives. Operating at the intersection of architecture,…
Added 9 hours ago
Senior Solutions Consultant
Appian Corporation
San Diego, CA
As a Senior Solutions Consultant, you have a unique opportunity to combine technical creativity with high-level business acumen. You won't just demo software; you will architect bespoke…
Added 9 hours ago
Senior Solutions Consultant
Appian Corporation
Seattle, WA
As a Senior Solutions Consultant, you have a unique opportunity to combine technical creativity with high-level business acumen. You won't just demo software; you will architect bespoke…
Added 9 hours ago
Senior Solutions Consultant
Appian Corporation
Los Angeles, CA
As a Senior Solutions Consultant, you have a unique opportunity to combine technical creativity with high-level business acumen. You won't just demo software; you will architect bespoke…
Added 9 hours ago
Senior Solutions Consultant
Appian Corporation
Dallas, TX
As a Senior Solutions Consultant, you have a unique opportunity to combine technical creativity with high-level business acumen. You won't just demo software; you will architect bespoke…
Added 9 hours ago
UG
Sr. AI/ML Engineer - Remote
UnitedHealth Group
Richardson, TX
- $120,100 to $214,500 USD / year
The Optum Health Technology team is seeking a Senior AI/ML Engineer with a solid data science background to build and scale cutting-edge AI-powered solutions that transform value-based care…
Added 9 hours ago
Senior Accountant
Advanced Navigation
Huntsville, AL
…quantum sensors and photonics to artificial intelligence and deep-sea sonar, our breakthroughs power the future for global giants like NASA, Tesla, Boeing, Google, and Apple. Now, we are…
Added 9 hours ago
Sr. Director, Modern Work, Infrastructure and Operations
Par Health Enterprises LLC
Hazelwood, MO
Oversees operational enablement for Azure AI, Azure OpenAI, machine learning platforms, retrieval-augmented generation services, vector databases, prompt and model management tools, and…

NVIDIA Corporation

Senior Software Architect, AI Networking

North District, IL, United States

Apply About employer

Applications open in a new tab.

Job details

Apply by: Mar 8, 2027
Experience: 8+ years of experience building large-scale distributed systems or performance-critical software.
Posting language: English
Posted: Sep 9, 2026

Original job description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by excellent technology - and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Join our team and discover how you can build a lasting impact on the world.

NVIDIA is seeking a sharp, innovative, and hands-on Architect to help shape the future of LLM inference at scale. Join our dynamic E2E Architecture group, where we build ground breaking systems powering the next generation of generative AI workloads. In this role, you will work across software and hardware domains to design and optimize inference infrastructure for large language models running on some of the most sophisticated GPU clusters in the world. You’ll help define how AI models are deployed and scaled in production, driving decisions on everything from memory orchestration and compute scheduling to inter-node communication and system-level optimizations. This is an opportunity to work with top engineers, researchers, and partners across NVIDIA and leave a mark on the way generative AI reaches real-world applications.

What You’ll Be Doing:

Design and evolve scalable architectures for multi-node LLM inference across GPU clusters.
Develop infrastructure to optimize latency, throughput, and cost-efficiency of serving large models in production.
Collaborate with model, systems, compiler, and networking teams to ensure complete, high-performance solutions.
Prototype novel approaches to KV cache handling, tensor/pipeline parallel execution, and dynamic batching.
Evaluate and integrate new software and hardware technologies relevant to Core Spectrum-X technologies, such as load balancing, telemetry, congestion control, vertical application integration.
Work closely with internal teams and external partners to translate high-level architecture into reliable, high-performance systems.
Author design documents, internal specs, and technical blog posts and contribute to open-source efforts when appropriate.

What We Need to See:

Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or equivalent experience.
8+ years of experience building large-scale distributed systems or performance-critical software.
Deep understanding of deep learning systems, GPU acceleration, and AI model execution flows and/or high performance networking.
Proven software engineering skills in C++ and/or Python, preferably demonstrate strong familiarity with CUDA or similar platforms.
Strong system-level thinking across memory, networking, scheduling, and compute orchestration.
Excellent communication skills and ability to collaborate across diverse technical domains.

Ways to Stand Out from the Crowd:

Experience working on LLM - training or inference pipelines, transformer model optimization, or model-parallel deployments.
Proven success in profiling and optimizing performance bottlenecks across the LLM training or inference stack.
AI Accelerators and distributed communication patterns, congestion control and/or load balancing.
Shown optimization process for complex systems, deployed at scale to make impact.
Proven experience successfully driving complex organizational processes from planning through implementation.

NVIDIA is widely considered one of the most desirable places to work in tech – we are passionate about what we do and are committed to fostering a culture of perfection, innovation, and collaboration. If you’re excited to help define how the world runs AI at scale, this role is for you. Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. While planning your future, explore the benefits available to you and your family at www.nvidiabenefits.com/

Apply About employer

More about this job

Skills

Scheduling
Communication skills
Computer science
Electrical engineering
Deep learning
C++
Python

Report this job