Jobs in the United States

25+ jobs

Save this search

Added 10 mins ago
Software Development Manager, Leo AI Foundations, Amazon Leo AI Foundations
Amazon Kuiper Manufacturing Enterprises LLC
Redmond, WA
Amazon Leo is Amazon's initiative to launch a constellation of low Earth orbit satellites to provide low-latency, high-speed broadband connectivity to unserved and underserved communities…
Added 33 mins ago
M
Senior Software Engineer - AI Infrastructure
Microsoft
WA · CA · Redmond, WA · Mountain View, CA · Redmond · Mountain View
- $119,800 to $261,000 USD / year
As a Senior Software Engineer, you will shape the future of one of the largest and fastest-growing services in Azure, foundational to Microsoft’s AI strategy. Our mission is to serve models…
Added 33 mins ago
M
Senior Software Engineer
Microsoft
WA · Redmond, WA · Redmond
- $119,800 to $261,000 USD / year
We are looking for a talented Senior Software Engineer to join us in pushing the boundaries of technology for the Copilot experience. In this role, you will work on building highly scalable…
Added 51 mins ago
Principal Forward Deployed Engineer
Zuora
Foster City, CA
…Deployed Product Manager and, where scope requires, a second engineer. Our focus: building the future of agentic quote-to-cash, which means helping enterprises monetize AI-native and…
Added 1 hour ago
Software Engineer 6 - Feature Infrastructure
Netflix
United States
…serving of feature values for both high-throughput training and low-latency member-scale inference use…
Added 1 hour ago
Senior C++ Software Engineer - Algorithmic Trading
Edgehog Trading
Chicago, IL
Design, implement, and optimize low-latency C++ applications for trading strategy execution.
Added 1 hour ago
Junior Software Engineer
Priceline.com LLC
NY
Apply your programming skills towards building low latency and high throughput transactional services.
Added 2 hours ago
Software Engineer 6 - Feature Infrastructure
Netflix Services Canada ULC
Remote, United States
…serving of feature values for both high-throughput training and low-latency member-scale inference use…
Added 2 hours ago
CX Machine Learning Engineer
Cisco
San Jose, CA
…machine learning lifecycle, you will own robust data pipelines, low-latency model serving, and LLMOps infrastructure while establishing rigorous automated evaluation and observability…
Added 2 hours ago
Principal, Machine Learning Software Engineer, Admin Central
Workday, Inc.
CA
…cloud-native tech. Architect multi-tenant runtimes that deliver fast, low-latency inference to millions of global…
Added 2 hours ago
Sr ML Software Development Engineer, Admin Central
Workday, Inc.
CA
…engineering and modern ML/LLM architectures. You will architect low-latency inference services, build automated feature stores and retraining pipelines over big data infrastructure (Kafka,…
Added 4 hours ago
Machine Learning Engineer- Inference Optimization | Experienced Hire
Susquehanna International Group, LLP
Bala Cynwyd (Philadelphia Area), PA
We are looking for a Machine Learning Engineer focused on low-latency inference optimization to help build, tune, and productionize high-performance model serving systems. This role sits at…
Added 4 hours ago
Software Engineer, Global Investment Research, Agentic Systems - Associate
Campus
Dallas, TX · NY
…that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside…
Added 4 hours ago
FG
Senior Software Engineer
Fitch Group
New York, NY
- $135,000 to $145,000 USD / year
Experience in optimized query patterns, pagination, caching, and schema design to ensure low-latency, performant reads at scale.
Added 4 hours ago
SDE-II, Supply Chain
Amazon.com Services LLC
Bellevue, WA
- Scalable Distributed Systems – Build highly available, low-latency services that process millions of decisions in real-time, powering the backbone of Amazon's transportation planning and…
Added 5 hours ago
Principal Engineer – Vice President
Citigroup
Irving, TX
Principal Java Engineer you will leverage your deep technical knowledge to drive the creation of high-quality software products. You will also be expected to mentor other engineers,
Added 6 hours ago
Technical Lead for Post Trade (Securities Lending) - Senior Vice President
Citigroup
Tampa, FL
The Equity Finance Technology team are seeking a highly skilled engineer for the Post Trade platform, located in Tampa. This role requires strong expertise in Java, messaging frameworks,…
Added 6 hours ago
Senior Software Engineer, Machine Learning Platform
Airwallex
Seattle, WA
- Experience with cloud platforms (e.g., AWS, GCP) and building large-scale, low-latency production machine learning infrastructure.
Added 12 hours ago
Software Test & Verification Engineer (Experienced or Senior)
The Boeing Company
Albuquerque, NM
…following: ground systems, control systems, embedded FPGA, low latency deterministic, operator interfaces, and/or control gimbals, ground antennas, optical…
Added 15 hours ago
Software Engineer II
US: Mastercard Technologies, LLC
O'Fallon, MO
As a Software Engineer II, you will combine strong software engineering fundamentals with modern enterprise platforms, automation, data, and AI-enabled engineering to solve complex business…
Added 18 hours ago
Principal Software Engineer, Platform
Seattle, WA
Lead the design of high-scale, low-latency distributed systems that process real-time events from millions of devices.
Added 18 hours ago
Senior Java Engineer
Interactive Brokers
New York, NY
Working knowledge of multithreading and concurrency, with an appreciation for lean, low-latency programming.
Added 18 hours ago
Director, Forward Deployed Engineer / 139510
KPMG LLP
Jackson, MS
Added 20 hours ago
Senior Staff Software Engineer, Data Engineering
Intuit
San Diego, CA · Mountain View, CA
Experience with low-latency NoSQL datastores (such as DynamoDB, HBase, Cassandra, MongoDB) is a plus. Experience with building stream-processing applications using Spark Streaming, Flink,…
Added 21 hours ago
SI
Staff Software Engineer, Spam and Abuse
Snap Inc.
Palo Alto, CA · Bellevue, WA
- $195,000 to $343,000 USD / year
Deep expertise in designing, building, and operating large-scale, low-latency distributed backend systems

Microsoft

Senior Software Engineer

United States

$119,800 to $261,000 USD / year

Apply About employer

Applications open in a new tab.

Job details

Pay: $119,800 to $261,000 USD / year
Apply by: Apr 24, 2027
Posting language: English
Posted: Oct 26, 2026

Original job description

Overview

We are looking for a Senior Performance Engineer with deep expertise in High-Performance Computing (HPC) and Artificial Intelligence (AI) networking performance, particularly across InfiniBand-based GPU clusters. You will be a key technical leader focused on understanding, analyzing, and optimizing the performance of distributed workloads running at massive scale - often involving tens of thousands of GPUs interconnected via high-speed networks. This role requires strong familiarity with Message Passing Interface (MPI), NVIDIA Collective Communications Library (NCCL), collective communication algorithms, and the underlying transport technologies (Remote Direct Memory Access (RDMA) over InfiniBand). You should have extensive experience with network-level debugging, topology-aware optimization, and low-latency, high-throughput communication tuning in Linux environments. If you enjoy solving hard problems at the convergence of network systems and distributed applications, we want to talk to you.

Responsibilities

Diagnose and resolve communication-related performance bottlenecks across large-scale distributed systems.
Analyze InfiniBand fabric behavior, including congestion, credit starvation, route imbalance, or link-level errors.
Tune and debug Remote Direct Memory Access (RDMA) transport layers, message ordering, path migration, and Quality of Service (QoS) policies on multi-rail or multi-subnet fabrics.
Develop custom tooling or scripts to analyze fabric telemetry, traffic flows, and job-induced network behavior.
Collaborate with operations team to ensure optimal use of fabric features (adaptive routing, congestion control, service level tuning).
Work closely with hardware vendors (e.g., NVIDIA) to evaluate and validate next-gen interconnects and switch firmware.
Support benchmarking of High-Performance Computing (HPC) / Artificial Intelligence (AI) workloads, including characterization of latency, bandwidth, and collective efficiency under scale.

Qualifications

Required Qualifications:

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
These requirements include, but are not limited to the following specialized security screenings:
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience.
Proven history of debugging network performance issues at scale (e.g., link-level failures, fabric hot spots, routing asymmetry).
Expert-level experience with Message Passing Interface (MPI), NVIDIA Collective Communications Library (NCCL), and collective algorithm behavior in multi-node, multi-GPU systems
Deep knowledge of InfiniBand architecture, including verbs, Remote Direct Memory Access (RDMA), Scalable Hierarchical Aggregation Protocol (SHARP), adaptive routing, congestion control, and Quality of Service (QoS).
Familiarity with job schedulers and network-aware scheduling/topology constraints.
Familiarity with GPU communication stack internals: GPU Direct RDMA and NVLink topologies.
Experience with real-world performance tuning of transformer training, large-scale AllReduce, or model/data parallel Artificial Intelligence (AI) workloads.

#azurecorejobs

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Apply About employer

More about this job

Skills

Microsoft Access
Debugging
Communication skills
Linux
Firmware
Computer science
C
C++
C#
Oracle Java
JavaScript
Python
Scheduling
Artificial intelligence

Report this job