Jobs in the United States

25+ jobs

Save this search

Added 4 mins ago
Senior Boundary Network Systems Engineer
CACI International
Linthicum Heights, MD
Job Title: Senior Boundary Network Systems Engineer
Added 37 mins ago
Senior Software Engineer, AI/ML Network Engineering
Cisco
Milpitas, CA
…solving complex technical challenges and building large-scale distributed systems. The team operates in a fast-paced, collaborative environment where engineers take ownership across the…
Added 37 mins ago
Principal Engineer Software Security Hybrid
Cisco
Research Triangle Park, NC
As a Principal Engineer on the AI Security team, you will be a senior technical authority shaping the security standard for every AI capability Cisco ships - to customers, partners, and…
Added 2 hours ago
Enterprise Technology Solution Architect
Deloitte US
Dallas, TX · Jacksonville, FL
Design and manage distributed data processing solutions using Hadoop, Cloudera, distributed file systems, and NoSQL databases.
Added 2 hours ago
EG
Cloud Engineer
Eliassen Group
Concord, NH
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 2 hours ago
EG
Cloud Engineer
Eliassen Group
Carson City, NV
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 3 hours ago
EG
Cloud Engineer
Eliassen Group
Bismarck, ND
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 4 hours ago
Senior Data Engineer, Network Platform
Cisco Systems, Inc.
Remote, United States
…accurately. The environment is at massive scale (10 PB+ across 30+ systems) and blends data engineering rigor with trusted data context - so teams can move from “data exists” to “data is…
Added 4 hours ago
Senior Software Engineer
Gravitee
Denver
A solid understanding of API design, data modeling, distributed systems, and asynchronous workflows.
Added 5 hours ago
Senior Full Stack Engineer
Vizient, Inc.
Irving, TX
Integrate applications with internal platforms, APIs, event streams, analytical data platforms, and external enterprise systems.
Added 5 hours ago
Systems Engineer, Junior
Torch Technologies, Inc.
Hanscom AFB, MA
…Surveillance Target Attack Radar System (JSTARS) aircraft, Air Force Distributed Common Ground System (AF DCGS), the Integrated Broadcast Service (IBS) system and other C2ISR programs as…
Added 5 hours ago
Principal Software Engineer
Ascend Learning, LLC
OR · Leawood, KS
Deep experience designing distributed systems, including microservices, event-driven architectures, and API design, with a focus on scalability, performance, and resilience
Added 5 hours ago
EG
Cloud Engineer
Eliassen Group
Harrisburg, PA
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 5 hours ago
Senior Data Engineer
Marathon Petroleum Company LP
San Antonio, TX · Findlay, OH
As a Senior Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions using modern data architecture, Azure data services, including Data…
Added 5 hours ago
Senior Software Engineer
Jorie AI
Remote, United States
We are seeking a Senior Software Engineer to design and deliver software for healthcare and other regulated industries, covering automation, web applications, and platform services. You…
Added 6 hours ago
EG
Cloud Engineer
Eliassen Group
Trenton, NJ
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 6 hours ago
M
Software Engineer 2 - XKS
Markon
Annapolis Junction, MD
- $120,000 to $145,000 USD / year
Markon is seeking an experienced Senior Software Engineer Level 2 to support a customer in the Annapolis Junction, MD area. This role will focus on developing, maintaining, and enhancing…
Added 6 hours ago
Senior DevSecOps Engineer
Peraton
Reston, VA
We're looking for an engineer who pairs strong technical execution with operational discipline and a builder mindset - someone with the judgment to design systems that are not only…
Added 6 hours ago
Site Reliability Engineer Level 2
Peraton
Laurel, MD
…AWS environments. The successful candidate will serve as a senior technical contributor responsible for designing, implementing, and maintaining automated deployment and infrastructure…
Added 6 hours ago
Senior Cloud Platform & Infrastructure Engineer
RPMS RoundPoint Mortgage Servicing
Remote, United States
The Senior Cloud Platform & Infrastructure Engineer will support RoundPoint Mortgage Servicing LLC. We are seeking an experienced Senior Cloud Platform & Infrastructure Engineer to design,…
Added 6 hours ago
TS
Senior Computational Scientist / Engineer, Trajectory Simulation
Triton Systems, Inc.
Chelmsford, MA
- $120,000 to $150,000 USD / year
We are seeking a Senior Computational Scientist / Engineer to provide technical leadership on research and development efforts within our Applied Computational Engineering group. This role…
Added 6 hours ago
Senior Gen AI Engineer
Fractal Analytics Inc
MA
We are looking for an experienced GenAI Senior Engineer to design, build, and maintain scalable, secure, and production-grade AI platforms and applications. The role will focus on…
Added 6 hours ago
IT Platform Engineer Senior
University of Maryland College Park (UMCP)
United States
The Senior Platform Engineer is a member of the Enterprise Linux Services team. This position is responsible for all aspects of IT system administration, enabling the University's research,…
Added 7 hours ago
MEO Missile Warning & Tracking (MWT) SEIT Engineer
The Aerospace Corporation
El Segundo, CA · Aurora, CO · Colorado Springs, CO
The Defense Systems Group (DSG) provides analysis-based decision support to senior leaders on space architectures, policy and strategy, technology development, warfighter capability…
Added 7 hours ago
MEO Missile Warning & Tracking (MWT) Lead SEIT Engineer
The Aerospace Corporation
El Segundo, CA · Aurora, CO · Colorado Springs, CO
Minimum Requirements for Senior Project Engineer - Systems Engineering - Acquisition and Systems Engineering:

ServiceNow

Senior Staff Software Engineer - AI/ML Inference Engineering

San Diego, CA, United States

Apply About employer

Applications open in a new tab.

Job details

Education: Bachelor’s degree
Experience: 8+ years of Backend software engineering experience
Posting language: English
Posted: Nov 4, 2026

Original job description

Company Description It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone - freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow - helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started. Join us to put AI to work for people.

Job Description

What you get to do in this role:

About the team - The AI Services Platform Group at ServiceNow is a customer-focused innovation group building intelligent software and smart user experiences using existing and latest advanced technologies to enable end-to-end, industry-leading work experiences for customers. We are a group of researchers, applied scientists, engineers, and product managers with a dual mission. We build and evolve the AI platform, and partner with teams to build products and end-to-end AI-powered work experiences. In equal measure, we lay the foundations, research, experiment, and de-risk AI technologies that unlock new work experiences in the future. We are seeking a Senior Staff Software Engineer - AI/ML Inference Engineering to lead the architecture, optimization, and operational excellence of our AI inference platform. You will own the end-to-end inference lifecycle - from onboarding cutting-edge models to deploying optimized inference engines in production across multiple backends on Kubernetes infrastructure. You'll also architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide observability, and enable advanced request routing. This role combines deep technical expertise in GPU compute, LLM APIs, inference frameworks, containerization, orchestration, and API gateway architecture with a bias toward pragmatic engineering and measurable performance impact.

Qualifications

To be successful in this role you have:

Expertise in Go or Python, OOP, Design Patterns, time and space-efficient algorithms
Model-serving and runtime experience, such as vLLM, TensorRT-LLM, Triton Inference Server.
Exposure to LLM APIs or ML-serving systems, or a clear ability to ramp up quickly
Experience building new products that use challenging algorithms
Expertise in coding efficient, object-oriented, modularized and quality software
Knowledge of core AI/ML techniques and algorithms
Knowledge of unit testing, profiling, and code tuning

AI skills Artificial intelligence strategy is a critical skill at Experienced proficiency for IC5 - it applies to how you build and to what you build.

Confident use of AI coding assistants such as GitHub Copilot or Cursor, paired with the critical eye to review AI-generated code as rigorously as any other - catching logic errors, security anti-patterns, and missed edge cases rather than treating model output as production-ready.
AI-assisted debugging and trace analysis, and a clear understanding of the data privacy rules governing what goes into a prompt.

Mandatory minimum

8+ years of Backend software engineering experience
4+ years of designing and operating distributed systems
Bachelor’s degree in computer science, software engineering, or a closely related technical field required.
A master’s degree may offset up to one year of the experience minimum. Equivalent practical experience is considered where technical depth is clearly demonstrable.

Desired skills:

Deploy, scale, and operate services in production Kubernetes environments, including Helm-based deployments and CI/CD pipelines that make releases repeatable and safe to roll back.
Own observability for what you build - meaningful metrics, useful logs, real tracing, and alerts that fire on customer impact rather than on noise.
Debug and resolve production incidents independently, participate in on-call, run root-cause analysis, and operate against defined service level objectives.

For positions in this location, we offer a base pay of $181,200 - $317,100, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location. Additional Information Work Personas We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service. Equal Opportunity Employer ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements. Accommodations We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact globaltalentss@servicenow.com for assistance. Export Control Regulations For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.

Apply About employer

More about this job

Skills

ML
ServiceNow
Research
Onboarding
Kubernetes
Go
Python
Object-oriented programming
Unit testing
GitHub
Computer science
CI/CD
Root cause analysis
Sales

Report this job