Jobs in the United States

25+ jobs

Save this search

Added 1 hour ago
WI
Staff Software Engineer
Walmart Inc.
Sunnyvale, CA
- $185,587 to $286,000 USD / year
…persistence and state management using Azure Cosmos DB for low-latency, globally distributed payment transaction storage, including TTL-based archival strategies and automated data…
Added 1 hour ago
Software Development Engineer, Specialist AI Tooling, Specialist Technology Team
Amazon
New York, NY
…ranking, skill assessment, and intelligent routing - ensuring low latency, high quality, and cost efficiency at…
Added 1 hour ago
Senior Software Engineer II of Trading
Charles Schwab
New York, NY
As a Senior Software Engineer II focusing on trading engineering, you will play a critical role in delivering a high-quality trading platform that powers trading functionality in the Forge…
Added 5 hours ago
WI
Software Engineer III
Walmart Inc.
Bentonville, AR
- $90,000 to $180,000 USD / year
Skills Required: designing and implementing microservices and frameworks using Java, Spring, Kafka, SQL, Cosmos, NoSQL, Hibernate, and Tomcat and data stores to enable user interaction with…
Added 10 hours ago
U
Sr Manager, Engineering - Engineer
Uber
San Francisco, CA
- $267,000 to $297,000 USD / year
We are seeking an Sr Engineering Manage with experience building and leading highly scalable, high throughput, low latency, multi tenant backend systems. Beyond technical expertise, we are…
Added 10 hours ago
Software Development Engineer II, Identity and Registry, AWS IoT Core
Amazon Development Center U.S., Inc.
Seattle, WA
- Build and operate highly available, low-latency distributed systems that handle device provisioning, authentication, metadata and state management
Added 10 hours ago
Software Development Engineer II, Identity and Registry, AWS IoT Core
Amazon Development Center U.S., Inc.
Seattle, WA
- Build and operate highly available, low-latency distributed systems that handle device provisioning, authentication, metadata and state management
Added 10 hours ago
Senior Audio Software Development Engineer
HP
Austin, TX
…with our physical hardware components to achieve pristine, low-latency…
Added 11 hours ago
Principal Software Engineer (Prisma Access)
Palo Alto Networks, Inc.
CA
…service meshes (e.g., Istio) to maintain high availability and low-latency security…
Added 13 hours ago
CX Machine Learning Engineer
Cisco Systems, Inc.
San Jose, CA
…machine learning lifecycle, you will own robust data pipelines, low-latency model serving, and LLMOps infrastructure while establishing rigorous automated evaluation and observability…
Added 13 hours ago
Senior Software Engineer, Infrastructure Engineering
Reddit
Remote, United States
…(iOS/Android/Web) to translate business and user needs into reliable, low-latency technical…
Added 13 hours ago
Application Platform Cloud Solutions Engineer Vice President
Citibank, N.A.
United States
Architect Network Connectivity: Design and engineer robust, low-latency, and secure network connectivity that links on-prem applications with external ecosystems - including client…
Added 13 hours ago
Software Development Engineer, Admin Central
Workday, Inc.
CA
Operational Monitoring: Monitor, triage, and resolve production issues to maintain high platform availability and low latency across global customer tenants.
Added 13 hours ago
Sr Software Development Engineer, Business Process Optimization
Workday, Inc.
CA
In this hands-on role, you will solve multi-petabyte-scale data challenges, build low-latency infrastructure backed by ClickHouse and big-data streaming pipelines (Kafka, Spark/Flink,…
Added 13 hours ago
Sr ML Engineer, Business Process Optimization
Workday, Inc.
CA
…engineering and modern ML/LLM architectures. You will architect low-latency inference services, build automated feature stores and retraining pipelines over big data infrastructure (Kafka,…
Added 13 hours ago
Software Development Engineer, Business Process Optimization
Workday, Inc.
CA
…ClickHouse, S3), write clean, scalable services in Python, Java, Go, or Scala, and help extend distributed telemetry and tracing to AI agent execution paths. You will collaborate closely…
Added 13 hours ago
Principal Machine Learning Engineer, Business Process Optimization
Workday, Inc.
CA
…cloud-native tech. Architect multi-tenant runtimes that deliver fast, low-latency inference to millions of global…
Added 14 hours ago
Software Development Manager, AI Foundations, Amazon Leo AI Foundations
Amazon Kuiper Manufacturing Enterprises LLC
Redmond, WA
Amazon Leo is Amazon's initiative to launch a constellation of low Earth orbit satellites to provide low-latency, high-speed broadband connectivity to unserved and underserved communities…
Added 15 hours ago
Sr. Software Engineer, Security Server Applications, Enterprise Technology Services
Apple
Sunnyvale, CA
6+ years of Experience with application design, development, and integration of high volume/low latency server applications
Added 15 hours ago
Software Development Manager, Leo AI Foundations, Amazon Leo AI Foundations
Amazon Kuiper Manufacturing Enterprises LLC
Redmond, WA
Amazon Leo is Amazon's initiative to launch a constellation of low Earth orbit satellites to provide low-latency, high-speed broadband connectivity to unserved and underserved communities…
Added 15 hours ago
M
Senior Software Engineer - AI Infrastructure
Microsoft
WA · CA · Redmond, WA · Mountain View, CA · Redmond · Mountain View
- $119,800 to $261,000 USD / year
As a Senior Software Engineer, you will shape the future of one of the largest and fastest-growing services in Azure, foundational to Microsoft’s AI strategy. Our mission is to serve models…
Added 15 hours ago
M
Senior Software Engineer
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
We are looking for a talented Senior Software Engineer to join us in pushing the boundaries of technology for the Copilot experience. In this role, you will work on building highly scalable…
Added 16 hours ago
Software Engineer 6 - Feature Infrastructure
Netflix
United States
…serving of feature values for both high-throughput training and low-latency member-scale inference use…
Added 16 hours ago
Senior C++ Software Engineer - Algorithmic Trading
Edgehog Trading
Chicago, IL
Design, implement, and optimize low-latency C++ applications for trading strategy execution.
Added 17 hours ago
Junior Software Engineer
Priceline.com LLC
NY
Apply your programming skills towards building low latency and high throughput transactional services.

Microsoft

Senior Software Engineer - AI Infrastructure

WA, United States
CA, United States
Redmond, WA, United States
Mountain View, CA, United States
Redmond, United States
Mountain View, United States

$119,800 to $261,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $119,800 to $261,000 USD / year
Apply by: Apr 25, 2027
Posting language: English
Posted: Oct 27, 2026

Original job description

Overview

Join our team within AI Infrastructure, where we are building the AI data-plane that powers all LLM inferencing workloads across Microsoft and Azure customers - from cutting-edge startups to Fortune 500 enterprises. Our converged AI fabric delivers inference capabilities for all LLMs in Microsoft catalog, including OpenAI, Anthropic, Mistral, Cohere, Llama, and more. As a Senior Software Engineer, you will shape the future of one of the largest and fastest-growing services in Azure, foundational to Microsoft’s AI strategy. Our mission is to serve models at scale - reliably, efficiently, and with ultra-low latency - enabling a rich set of AI-powered product experiences. This is a rapidly evolving space with immense opportunities to learn, innovate, and drive industry-wide impact!

Responsibilities

Design and implement highly scalable, reliable, and performant distributed systems that power Azure AI traffic management and scheduling.
Drive architecture and technical direction for routing, capacity allocation, and workload optimization services.
Develop algorithms and control-plane systems that intelligently distribute AI workloads across global infrastructure while meeting latency, availability, and cost objectives.
Collaborate with partner teams to onboard new models, regions, and customer offerings while maintaining operational excellence.
Build observability and operational tooling to monitor service health, capacity utilization, traffic patterns, and customer impact in near real-time.
Lead investigations into complex production issues and drive systematic improvements to reliability, resiliency, and platform automation.
Identify and execute opportunities to improve fleet efficiency, reduce operational overhead, and optimize utilization of premium AI infrastructure.
Mentor engineers, review designs and code, and raise engineering standards across the organization.
Drive engineering excellence through testing, automation, documentation, and operational best practices.
Influence long-term platform strategy and contribute to roadmap planning for next-generation AI infrastructure.

Qualifications

Required Qualifications:

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Preferred Qualifications:

Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Experience with telemetry, metrics pipelines, or resource scheduling systems.
Familiarity with cloud platforms (Azure, AWS, GCP) and container orchestration (Kubernetes, Service Fabric).
Experience operating large-scale services with stringent reliability and availability requirements.
Experience with distributed storage systems, telemetry platforms, and real-time data processing.
Familiarity with AI/ML infrastructure, GPU fleets, inference serving systems, or large-scale model deployment platforms.
Experience leading cross-team initiatives and driving projects from design through production deployment and operation.

Other Requirements:Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. #AIINFRA

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Apply About employer

More about this job

Skills

Scheduling
Monitor customer service
Documentation
Computer science
C
C++
C#
Oracle Java
JavaScript
Python
Microsoft Azure
AWS
Google Cloud
Kubernetes
Process data
ML

Report this job