Jobs in the United States

25+ jobs

Group jobs by employerEmail me new jobs Save this search

Added just now
Salesforce Systems Development Intern
Origin Bank
Ruston, LA
Qualifications/Skills (must possess the following):
Added 1 min ago
U
Commercial Operations Coordinator
Unlearn
San Francisco, CA
- $105,000 to $117,000 USD / year
Drug development and AI evolve rapidly. We stay curious, embrace new information, and change course when the evidence changes. We keep a close eye on where the industry is heading and build…
Added 1 min ago
Manager- Segment Communications
Covista
Columbia, MD
We operate on a hybrid schedule with four in-office days per week (Monday–Thursday)
Added 2 mins ago
Senior Associate Marketing Project Manager
Pilgrim\'s
Greeley, CO
Senior Associate Manager, Marketing Project Management
Added 2 mins ago
House Manager Aide
Merakey
Crafton, PA
The employee must possess
Added 2 mins ago
Deli Clerk - PT - #156 Cosentino's Sun Fresh - 10225 N. Oak Trafficway KCMO 64155
Cosentino's Food Stores
Kansas City, MO
Completion of ongoing training and development as listed on the Cosentino’s Learning Plan.
Added 2 mins ago
Manager, Sales Strategy & Operations
DoorDash USA
Remote, United States
We are looking for a Manager in Sales Strategy and Operations to be the strategic and operational partner to our SMB Business Development (BD) team as it expands its remit and increases…
Added 3 mins ago
Vice President, Commercial Banker
Western Alliance Bank
Flagstaff, AZ
Engage in business development activities and solicitation of new business based on the target market.
Added 3 mins ago
Coordinator, Facilities
The Friedkin Group
Houston, TX
Must have positive attitude and customer relations skills
Added 3 mins ago
W
(USA) Senior Manager, Specialty Compliance and Ethics - Fleet Safety
Walmart
Bentonville, AR
- $90,000 to $180,000 USD / year
We are seeking a strategic Senior Manager, Fleet Safety & Compliance to lead safety, regulatory compliance, and driver development programs across Walmart’s Regional Training Center…
Added 3 mins ago
AV
Surgical Counselor
Atlantic Vision Partners
Williamsburg, VA
- $20 to $26 USD / hour
Assists in the development and implementation of scheduling policies and best practices to improve workflow.
Added 3 mins ago
Product Manager
Meta
Little Rock, AR
Drive product development with teams of world-class engineers and designers, while maintaining team health
Added 3 mins ago
Senior Data Scientist (Remote)
GovCIO
Little Rock, AR
Learning & Development platform, to include certification preparation content
Added 3 mins ago
Lead Insurance Product Manager - Part D/PDP
Humana
Little Rock, AR
Humana is seeking a Medicare Part D expert to join the team as a Lead Insurance Product Manager who is ready to shape PDP strategy, guide complex decisions and turn regulatory requirements…
Added 3 mins ago
Applied Machine Learning Engineer
Best Buy
Richfield, MN
As the Applied Machine Learning Engineer, you’ll build and operate the ML systems behind Best Buy’s search, product discovery, gift recommendations, and homepage personalization -…
Added 3 mins ago
Global Supply Chain Manager, ODM Network Switches Infrastructure Supply Chain
Meta
Little Rock, AR
Global Supply Chain Manager, ODM Network Switches Infrastructure Supply Chain Responsibilities:
Added 3 mins ago
SYSTEMS CLINICAL NUTRITION MANAGER II
Compass Group, North America
Little Rock, AR · Fayetteville, AR
Education Reimbursement – Financial support for advanced learning
Added 3 mins ago
Privacy Data Analyst, Evidencing and Monitoring
Meta
Little Rock, AR
Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
Added 3 mins ago
O
Consulting Senior Practice Manager
Oracle
Little Rock, AR
- $120,200 to $264,100 USD / year
The Senior Practice Manager is responsible for leading a consulting team that helps customers turn their investment in NetSuite into measurable, lasting business value. The role combines…
Added 3 mins ago
Analytics Program Manager
Meta
Little Rock, AR
Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
Added 4 mins ago
Senior Talent Acquisition Specialist
Trustees of University of Pennsylvania
United States
…Penn’s distinctive interdisciplinary approach to scholarship and learning. As an employer Penn has been ranked nationally on many occasions with the most recent award from Forbes who named…
Added 5 mins ago
Director, Sr Family Office Relationship Manager
Charles Schwab Inc.
Other, CA
…every day. We champion our employee strengths, guide their development, and invest in their long-term success. We hire optimistic, results-oriented, curious, innovative, and adaptable…
Added 5 mins ago
Manufacturing Equipment and Process Engineer
Tate - Open
Glasgow, KY
Must possess valid driver license
Added 5 mins ago
Commissioning Manager (Electrical)
Tate - Open
Pocahontas, AR · Glasgow, KY · Saint Paul, VA · Red Lion, PA · Columbia, MD
The Commissioning Manager supports all aspects of where we integrate and test any electrical or mechanical infrastructure in our Raised Access Floors and Data Center products within our…
Added 5 mins ago
Piping Designer
Tate - Open
Columbia, MD
Mentorship and development: At Tate, we don’t believe in hierarchy, we work together as one team for one common goal. You will have access and exposure to our senior leaders and experts for…

Cerebras Systems

Engineering Manager, Inference Router

Sunnyvale, CA, United States

Apply on jobs.ashbyhq.com About employer

Applications open in a new tab.

Job details

Posting language: English
Posted: Oct 13, 2026

Original job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership https://openai.com/index/cerebras-partnership/ with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

ABOUT THE ROLE

The Inference Router team at Cerebras builds the systems that decide where every inference request runs. We route traffic across all of Cerebras’ data centers and third-party integrations, balancing heterogeneous compute, maximizing cache utilization, and delivering the industry’s lowest time-to-first-token (TTFT) at massive scale.

As an Engineering Manager, Inference Router, you will lead the team responsible for the intelligent control plane of the fastest generative AI inference platform in the world. Your team owns global request routing, prefill/decode (P/D) disaggregation, prefix-aware routing for high cache hit rates, autoscaling, and the high-availability infrastructure that keeps the platform fast and reliable under real-time, bursty load.

This role operates at the intersection of distributed systems, Kubernetes-based infrastructure, routing-algorithm design, and machine learning. It combines technical leadership, people management, and execution ownership, with direct impact on the latency, throughput, and reliability experienced by every Cerebras inference customer.

WHAT YOU’LL DO

TECHNICAL LEADERSHIP

Own the architecture and evolution of the inference routing layer across all Cerebras data centers and third-party inference integrations.
Guide the design of:
global, multi-region request routing and load balancing;
routing for heterogeneous compute, including prefill/decode (P/D) disaggregated serving;
prefix-aware / cache-aware routing to maximize KV-cache reuse and utilization;
low-TTFT, high-throughput request scheduling under concurrent, bursty workloads.
Drive the routing algorithms that trade off cache locality, queueing, load, and latency in real time.
Invest in simulation: build high-fidelity models of the fleet and its workloads so the team can validate routing policies, failover behavior, and scaling decisions under a wide range of conditions without tying up precious accelerator capacity.
Partner with inference runtime, cloud/platform, hardware, and ML teams to optimize end-to-end performance.

TEAM LEADERSHIP

Build, manage, and grow a team of distributed systems, infrastructure, and ML systems engineers.
Provide technical direction, mentorship, and career development.
Foster a culture of ownership, velocity, and operational excellence.
Recruit top talent in distributed systems, Kubernetes/infrastructure, and routing/ML systems.

EXECUTION & DELIVERY

Drive execution of complex, cross-functional initiatives spanning inference runtime, cloud/infrastructure, and ML teams.
Own delivery of capabilities such as:
prefix- and cache-aware routing policies;
P/D-disaggregation-aware scheduling and placement;
autoscaling and capacity management across heterogeneous fleets;
high availability, failover, and graceful degradation;
simulation and load-generation frameworks that exercise the router under diverse traffic patterns, failure modes, and fleet topologies - without consuming scarce production compute;
observability, SLOs, and reliability across the routing stack.
Ensure high-quality releases through strong testing, load/chaos validation, and operational rigor.

PLATFORM & PERFORMANCE OWNERSHIP

Scale the routing layer to handle very large volumes of concurrent requests at the lowest possible latency.
Drive improvements in TTFT, throughput, cache-hit rate, and compute efficiency across the fleet.
Design for reliability and high availability: failover, redundancy, scale-out, and fail-closed behavior under partial outages.
Identify and prioritize technical debt and system bottlenecks.
Maintain Cerebras’ industry-leading inference speed advantage.

CROSS-FUNCTIONAL COLLABORATION

Partner with:
inference runtime teams (execution and serving);
cloud/platform and SRE teams (deployment, scaling, reliability);
ML researchers and engineers (model enablement, routing signals);
third-party integration partners.
Act as a bridge between infrastructure, routing, and production systems.

WHAT YOU BRING

8+ years of experience in large-scale software engineering, distributed systems, or infrastructure.
2+ years of engineering management experience.
Strong programming skills in C++ and/or Go for performance-critical, concurrent production systems.
Deep experience operating production services on Kubernetes: deployments, autoscaling, rollout strategies, and multi-cluster/multi-region topologies.
Proven track record building and operating highly available, scalable systems: load balancing, failover, scale-out, and reliability engineering.
Experience designing or operating request routing, load balancing, scheduling, or traffic-management systems at scale.
Experience with cloud infrastructure and best practices for building scalable microservices.

PREFERRED SKILLS

Experience with large-scale LLM/inference serving and the systems around it (e.g. vLLM, TensorRT-LLM, SGLang, or comparable).
Familiarity with prefill/decode (P/D) disaggregation, KV-cache management, and prefix/cache-aware routing.
ML background: understanding of inference workloads, batching, and the performance characteristics of serving LLMs and multimodal models.
Experience with autoscaling and capacity management across heterogeneous compute.
Experience building simulation, modeling, or load-testing frameworks for distributed systems to validate behavior cost-effectively at scale.
Strong grounding in observability (metrics, tracing, SLOs) and incident response for high-traffic production systems.

WHY THIS ROLE MATTERS

The Inference Router is the control plane behind Cerebras’ core promise: the fastest AI inference in the world. The routing decisions your team makes - across data centers, across heterogeneous compute, with cache-awareness and high availability - directly determine the latency, throughput, and reliability every customer experiences. Your work keeps real-time AI applications fast and dependable, and unlocks new capabilities across enterprise and frontier AI use cases.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here https://www.cerebras.ai/join-us!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here https://www.cerebras.net/privacy/ to review our CCPA disclosure notice.

Apply on jobs.ashbyhq.com About employer

Report this job

Work requirements

Jobs in the United States