Jobs in the United States

25+ jobs

Save this search

Added 16 mins ago
Software Engineer III - Full-stack Developer with Anthropic Experience
Deloitte
Minneapolis, MN
Software Engineer III with Agentic AI Experience, AI & Engineering/Engineering as a Service
Added 39 mins ago
Backend Software Engineer
Steampunk
Remote, United States
As a Backend Software Engineer, you will work on modernizing legacy enterprise systems by decomposing monolithic Java and .NET services into cloud-native Python microservices. This role is…
Added 39 mins ago
Backend Software Engineer
Steampunk
Remote, United States
As a Backend Software Engineer, you will work on modernizing legacy enterprise systems by decomposing monolithic Java and .NET services into cloud-native Python microservices. This role is…
Added 1 hour ago
Software Engineer (Hybrid)
Cisco Systems, Inc.
San Jose, CA · RTP, NC
Bachelor’s degree with 5+ years of software engineering experience in complex, large-scale enterprise environments, including proficiency in Java/J2EE, Spring, TypeScript, Python,…
Added 1 hour ago
O
Lead Principal Platform Software Engineer
Oracle
United States
- $113,600 to $306,400 USD / year
Proficiency in Python and Java with experience developing and maintaining production software in both languages.
Added 3 hours ago
Staff Software Engineer, Data & Scalability Platform
Cisco
New York, NY
As a Staff Software Engineer on the Data & Scalability Platform team, you will provide technical leadership for the architecture, scalability, and cost of the entire data plane: the stores…
Added 12 hours ago
Software Engineer III - Full-stack Developer with Anthropic Experience
Deloitte
Boston, MA
Software Engineer III with Agentic AI Experience, AI & Engineering/Engineering as a Service
Added 15 hours ago
TT
Lead Platform Engineer
True Talent Solutions Partners
San Francisco, CA
- $220,000 to $300,000 USD / year
- At least 5 years of platform or infrastructure engineering experience, with a track record building and operating production backend infrastructure, data platforms, or distributed systems.
Added 16 hours ago
Senior Software Engineer, NeMo Helix Core Platform
NVIDIA Corporation
ON, CA
We are looking for a Senior Software Engineer to help build NeMo Helix, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role is for a senior…
Added 16 hours ago
Senior Platform Software Engineer
Raydar
Palo Alto, CA
- Solid backend engineering experience with Python or Go, APIs, databases and distributed systems.
Added 16 hours ago
O
Lead Principal Site Reliability Engineer
Oracle
Nashville, TN
- $96,300 to $264,100 USD / year
Advanced experience with at least one major cloud platform, such as Oracle Cloud Infrastructure, Amazon Web Services, Microsoft Azure, or Google Cloud Platform.
Added 17 hours ago
TT
Senior Platform Engineer
True Talent Solutions Partners
New York, NY
- $175,000 to $220,000 USD / year
- Hands-on experience with AWS production workloads and designing large-scale data storage and retrieval across hot and cold tiers.
Added 20 hours ago
Senior AI Tools Engineer, SRE Operations - GeForce NOW
NVIDIA USA
Remote, United States
We are seeking a passionate AI Tools Engineer to join the Site Reliability Engineering (SRE) Data Team. Applicants with SRE or equivalent experience are encouraged.
Added 20 hours ago
J
DevOps Engineer
Jobot
Montebello, CA
- $80,000 to $85,000 USD / year
We are looking for a DevOps Engineer with cloud operations, Kubernetes, DevOps, and security operations experience to help build a stable, secure, and auditable production operations system.
Added 21 hours ago
RC
Part Time Software Platform Engineer Co-Op (Remote)
RTX Corporation
richardson, TX
- Part-time
Raytheon is hiring SW Platform Engineer Co-Ops as a part of the Raytheon Cooperative Education Program (Co‑op). This is a part-time, remote role targeting senior or postgraduate students…
Added 21 hours ago
ND
Software & DevOps Engineer
NTT Data Americas, Inc.
Irving, TX
- $55 to $66 USD / hour
Minimum 5+ years of Experience with containerization and orchestration technologies, including Docker and Kubernetes.
Added 21 hours ago
Senior Confluent Kafka Platform Admin
Charles Schwab
Austin, TX
Event Streaming team in Enterprise Middleware organization is seeking a Senior Kafka Platform Engineer with experience to lead the evolution of its enterprise event-streaming platform and…
Added 1 day ago
O
Lead Principal Site Reliability Engineer - (work in Vienna VA location)
Oracle
Jefferson City, MO
- $96,300 to $264,100 USD / year
Experience with Kubernetes, Docker, and container orchestration platforms.
Added 1 day ago
Senior DevOps Engineer, Observability and FinOps
CACI International
Reston, VA
This engineer makes mission systems visible and their costs accountable, on networks that cannot call out to the internet. The role blends platform engineering (Kubernetes/OpenShift,…
Added 1 day ago
ND
Gen AI Senior Engineer
NTT Data Americas, Inc.
Charlotte, NC
- $65 to $75 USD / hour
NTT DATA's Client is currently seeking an AWS Data & AI Platform Engineer to join our team in Charlotte, North Carolina (US-NC), United States (US).
Added 1 day ago
DA
Senior Software Development Engineer
Delta Air Lines, Inc.
Minneapolis, MN
- $81,300 to $221,000 USD / year
As a Senior Software Development Engineer, you will lead the design, development, and optimization of complex software applications. You will mentor junior engineers and collaborate with…
Added 1 day ago
VU
Software Development Engineer- Product Reliability Engineering
Visa USA Inc
Denver, CO
- $40,123 USD / year
…product, and automation as a strategic advantage. You'll write Python, build agentic AI tools, manage data platforms, and contribute to the distributed systems that process billions of…
Added 1 day ago
Sr. Staff Software Engineer, Big Data Platform
Pinterest, Inc.
NEW YORK, NY
Added 1 day ago
Forward Deployed Engineer - Applied AI - Senior Manager - Financial Services - Consulting
EY
New York, NY
Partner with senior leaders across Engineering, Architecture, Product, Data, Security, Operations, and engagement leadership to align strategy with execution.
Added 1 day ago
Cloud Engineer 5
Capital One
New York, NY
…are seeking Cloud Engineers who are passionate about marrying data with emerging technologies to join our team. As a Cloud Engineer, you’ll have the opportunity to be on the forefront of…

Closed listing

JPMorgan Chase

SR Principal Software Engineer - LLM Engineering

Chicago, IL, United States

Base Pay/Salary Palo Alto,CA $232,750.00-$325,000.00; Seattle,WA $232,750.00-$325,000.00; Chicago,IL $204,250.00-$300,000.00; New York,NY $232,750.00-$325,000.00; Jersey City,NJ $232,750.00-$325,000.00

This opening has closed.

The original listing is kept below for reference.

Find open jobs More jobs with this employer

About employer

Job details

Pay: Base Pay/Salary Palo Alto,CA $232,750.00-$325,000.00; Seattle,WA $232,750.00-$325,000.00; Chicago,IL $204,250.00-$300,000.00; New York,NY $232,750.00-$325,000.00; Jersey City,NJ $232,750.00-$325,000.00
Posting language: English
Posted: Mar 25, 2026

Similar jobs hiring now

Search current openings

Original job description

Archived listing. The details below describe a past opening.

SR Principal Software Engineer - LLM Engineering

Palo Alto, CA, United States

and 4 more

Job Information

Job Identification 210723475
Job Category Software Engineering
Business Unit Commercial & Investment Bank
Posting Date 08/24/2026, 02:52 PM
Locations 3223 Hanover St, Palo Alto, CA, 94304, US270 Park Ave, New York, NY, 10017, US1 S Clark St, Chicago, IL, 60603, US545 Washington Blvd, Jersey City, NJ, 07310, US1301 2nd Ave, Seattle, WA, 98101, US
Job Schedule Full time
Job Shift Day
Base Pay/Salary Palo Alto,CA $232,750.00-$325,000.00; Seattle,WA $232,750.00-$325,000.00; Chicago,IL $204,250.00-$300,000.00; New York,NY $232,750.00-$325,000.00; Jersey City,NJ $232,750.00-$325,000.00

Job Description

We’re looking for a tech leader ready to take their career to new heights. Join the ranks of top talent at one of the world’s most influential companies.

As a Senior Principal Software Engineer at JPMorganChase within the Commercial & Investment Bank Trust & Safety Fraud Prevention team, you provide deep engineering expertise and work across agile teams to enhance, build, and deliver trusted market‑leading technology products in a secure, stable, and scalable way. Leverage your deep expertise to consistently challenge the status quo, innovate for business impact, lead the strategic development behind new and existing products and technology portfolios, and remain at the forefront of industry trends, best practices, and technological advances.

Job responsibilities

Advises and leads on the strategy, architecture, and development of model serving solutions for different model architectures (including LLMs & GNNs) across cloud and on‑premises environments, aligning initiatives to business outcomes.
Defines and implements MLOps and LLMOps strategies for end‑to‑end model lifecycle management, including training, versioning, deployment, monitoring, and governance.
Drives optimization of model inferencing for high throughput and low latency using quantization, model parallelism, intelligent batching, and hardware acceleration for all model architectures.
Sets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-authorized tools within the work environment) to drive measurable improvements in delivery speed, reliability, and code quality (e.g., AI-orchestrated SDLC/TLM automation, release readiness gating, incident triage/root-cause acceleration, and large-scale refactoring/test modernization), while defining guardrails for validation, security, resiliency, and reuse across teams and functions.
Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale.
Creates durable, reusable software and platform frameworks to standardize ML Engineering services, enabling scale across teams and functions.
Establishes best practices for automation, CI/CD, and infrastructure‑as‑code using containerization and orchestration technologies.
Partners closely with data science, platform engineering, and SRE teams to productionize models on AWS, ensuring observability, reliability, and cost efficiency.
Leads deployment and optimization using model inference servers such as Triton Inference Server and vLLM for high‑throughput, low‑latency serving at scale.
Oversees production operations for AI workloads, including monitoring, incident response, security, and compliance, with continuous improvement.
Translates complex technical concepts and emerging trends into actionable strategies, influencing senior stakeholders and cross‑functional partners to prioritize and deliver AI/ML capabilities that drive measurable business impact while promoting a culture of diversity, opportunity, inclusion, and respect.
Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 10+ years of applied experience.
8+ years of AI/ML engineering experience with significant expertise in LLMs, GNNs and other model architectures (e.g., GPT, Llama, Falcon, Mistral).
Demonstrated success architecting and deploying LLM & GNN solutions on AWS (e.g., SageMaker, Bedrock, EKS) at enterprise scale; experience with Azure ML or GCP Vertex AI.
Experience building LLM and GNN serving platforms in large‑scale environments typical of major tech firms.
Hands‑on experience building LLM inference engines using Triton Inference Server and vLLM, including autoscaling, caching, and throughput optimization.
Advanced proficiency in Python and optimization techniques applied to deep learning frameworks (PyTorch, TensorFlow, Hugging Face Transformers).
Deep understanding of LLMOps/MLOps (e.g., MLflow, SageMaker Pipelines, Kubeflow) with a track record of implementing best practices at scale.
Demonstrated experience designing and scaling agentic AI-enabled development patterns (using enterprise-authorized tools within the work environment) across teams/functions, including establishing governance for human-in-the-loop validation, traceability/auditability, and secure handling of sensitive inputs/outputs.
Strong understanding of responsible AI use and control expectations at scale, including security/resiliency implications, data sensitivity, and risk-based governance; ability to advise senior leaders on safe adoption, reuse, and measurable outcomes.
Expertise in inference optimization and distributed systems for large models focused on high‑throughput, low‑latency applications, including system design, testing, and operational stability for enterprise AI platforms.
Excellent communication skills with proven collaboration with SRE to implement observability, incident response, and SLIs/SLOs for LLM services, and the ability to influence both technical and non‑technical stakeholders to deliver value across functions at scale..

Preferred qualifications, capabilities, and skills

Master’s or PhD in Computer Science, Engineering, or a related field (or equivalent experience).
Practical cloud‑native experience, including containerization (Docker), orchestration (Kubernetes), and infrastructure‑as‑code (Terraform, CloudFormation).
Expertise in security, compliance, and governance for AI/ML deployments in regulated environments.
Experience in trust and safety or fraud prevention domains; familiarity with payments platforms is a plus.
Track record of contributions to open‑source LLM projects or peer‑reviewed research and/or experience presenting at industry conferences or leading technical communities.
Familiarity with hardware acceleration strategies across GPUs, TPUs, and specialized inference runtimes.
Experience in building java based applications

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries.

About Us

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs (https://careers.jpmorgan.com/us/en/how-we-hire/faqs) for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

About the Team

J.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.

About employer

More about this job

Skills

Software development
ML
CI/CD
Infrastructure as code
AWS
Incident response
Regulatory compliance
Process improvement
Microsoft Azure
Google Cloud
Python
Deep learning
PyTorch
TensorFlow
Hugging Face
Mlflow
Kubeflow
Communication skills
Collaboration
Computer science
Docker
Kubernetes
IBM Terraform
Research
Securities

Report this job