Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added just now
DevOps Platform Engineer
Booz Allen Hamilton_United States
Arlington, VA · Eglin AFB, FL · Hill AFB, UT
…their code. That’s why we need you, an experienced DevSecOps engineer, to help us shorten the time it takes to get critical tools developed and into the hands of digital citizens and…
Added just now
Cloud Engineer
Booz Allen Hamilton_United States
Arlington, VA
2+ years of experience with scripting tools and languages, including Ansible, Terraform, or Python
Added just now
DevOps Engineer
Booz Allen Hamilton_United States
Arlington, VA
DevOps engineering requires a specific mix of development, engineering, and communication skills. As a DevOps engineer, you know that these skills create efficiency and effectiveness so you…
Added 1 min ago
Senior Automation & Observability Engineer
Ensono
Jefferson City, MO
We are seeking an experienced IoT / Observability Engineer responsible for monitoring, managing, automating, and optimizing enterprise infrastructure, applications, IoT platforms, and…
Added 3 mins ago
AT
Senior Software Engineer (Reston or Cambridge)
Akamai Technologies, Inc.
Jefferson City, MO
- $121,400 to $218,600 USD / year
We are seeking an experienced, self-motivated, and highly productive Senior Software Engineer with a solid systems background. In this role, you will be involved in the support,…
Added 3 mins ago
Staff Machine Learning Engineer
Qualtrics
Seattle, WA
Staff Machine Learning Engineer, Foundation - Seattle
Added 3 mins ago
Senior Systems Architect
University of Michigan
Ann Arbor, MI
The HITS Unix/Linux and Container Services Team at Michigan Medicine is seeking a candidate to fulfill the role of Unix Systems Engineer.
Added 4 mins ago
E
Expert Automation & Observability Engineer
Ensono
Jefferson City, MO
- $140,000 to $180,000 USD / year
We are seeking an Expert Observability Engineer to serve as the strategic technical lead and architect for our enterprise Observability, APM, and Telemetry ecosystems. You will lead the…
Added 4 mins ago
Senior Data Engineer
St. George Tanaq Corporation
Jefferson City, MO
We are seeking a Senior Data Engineer to design, optimize, and maintain data pipelines and systems that support HUD AI/ML proofs of concept and pilots. This role will ensure efficient,…
Added 5 mins ago
Senior Engineer
PricewaterhouseCoopers Advisory Services LLC
Chicago, IL · Raleigh, NC · Charlotte, NC · Cincinnati, OH · Cleveland, OH · Columbia, SC · Columbus, OH · Dallas, TX · Baltimore, MD · Richmond, VA · Rochester, NY · Rosemont, IL · Boston, MA · St. Louis, MO · Salt Lake City, UT · San Antonio, TX · Seattle, WA · Spartanburg, SC · Albany, NY · Stamford, CT · Tampa, FL · Atlanta, GA · Toledo, OH · Austin, TX · Tulsa, OK · Washington, DC · Denver, CO · Des Moines, IA · Detroit, MI · Boca Raton, FL · Buffalo, NY · Florham Park, NJ · Fort Worth, TX · Greensboro, NC · Hartford, CT · Houston, TX · Grand Rapids, MI · Jacksonville, FL · Kansas City, MO · Las Vegas, NV · Little Rock, AR · Louisville, KY · Birmingham, AL · Fayetteville, AR · Melville, NY · Miami, FL · Milwaukee, WI · Minneapolis, MN · Montpelier, VT · Nashville, TN · New Orleans, LA · Oklahoma City, OK · Orlando, FL · Philadelphia, PA · Phoenix, AZ · Pittsburgh, PA · Portland, OR
As a Senior Engineer you will help design, build, and test custom applications within our Advisory practice, bringing together software engineering, cloud-based solution delivery, and…
Added 5 mins ago
Senior Lead Engineer
PricewaterhouseCoopers Advisory Services LLC
Chicago, IL · Raleigh, NC · Charlotte, NC · Cincinnati, OH · Cleveland, OH · Columbia, SC · Columbus, OH · Dallas, TX · Baltimore, MD · Richmond, VA · Rochester, NY · Rosemont, IL · Boston, MA · St. Louis, MO · Salt Lake City, UT · San Antonio, TX · Seattle, WA · Spartanburg, SC · Albany, NY · Stamford, CT · Tampa, FL · Atlanta, GA · Toledo, OH · Austin, TX · Tulsa, OK · Washington, DC · Denver, CO · Des Moines, IA · Detroit, MI · Boca Raton, FL · Buffalo, NY · Florham Park, NJ · Fort Worth, TX · Greensboro, NC · Hartford, CT · Houston, TX · Grand Rapids, MI · Jacksonville, FL · Kansas City, MO · Las Vegas, NV · Little Rock, AR · Louisville, KY · Birmingham, AL · Fayetteville, AR · Melville, NY · Miami, FL · Milwaukee, WI · Minneapolis, MN · Montpelier, VT · Nashville, TN · New Orleans, LA · NY · Oklahoma City, OK · Orlando, FL · Philadelphia, PA · Phoenix, AZ · Pittsburgh, PA · Portland, OR
As a Senior Lead Engineer you will lead custom application development and testing efforts that help clients turn business needs into scalable software solutions across cloud-native and…
Added 5 mins ago
Lead Engineer
PricewaterhouseCoopers Advisory Services LLC
Chicago, IL · Raleigh, NC · Charlotte, NC · Cincinnati, OH · Cleveland, OH · Columbia, SC · Columbus, OH · Dallas, TX · Baltimore, MD · Richmond, VA · Rochester, NY · Rosemont, IL · Boston, MA · St. Louis, MO · Salt Lake City, UT · San Antonio, TX · Seattle, WA · Spartanburg, SC · Albany, NY · Stamford, CT · Tampa, FL · Atlanta, GA · Toledo, OH · Austin, TX · Tulsa, OK · Washington, DC · Denver, CO · Des Moines, IA · Detroit, MI · Boca Raton, FL · Buffalo, NY · Florham Park, NJ · Fort Worth, TX · Greensboro, NC · Hartford, CT · Houston, TX · Grand Rapids, MI · Jacksonville, FL · Kansas City, MO · Las Vegas, NV · Little Rock, AR · Louisville, KY · Birmingham, AL · Fayetteville, AR · Melville, NY · Miami, FL · Milwaukee, WI · Minneapolis, MN · Montpelier, VT · Nashville, TN · New Orleans, LA · NY · Oklahoma City, OK · Orlando, FL · Philadelphia, PA · Phoenix, AZ · Pittsburgh, PA · Portland, OR
As a Lead Engineer you will guide the design, build, testing, and modernization of custom applications across cloud-native and on-premise environments, using modern engineering approaches,…
Added 5 mins ago
Sr. Principal Engineer, Spacecraft Health & Observability
Blue Origin Personnel, LLC
Denver, CO · Hutto, TX · Space Coast, FL · Huntsville, AL · Kent, WA
As a Principal Engineer for Fleet Health & Observability, you will be the single point of ownership for answering the critical question: "Is our constellation healthy?" You will architect…
Added 5 mins ago
DevSecOps Engineer III
Blue Origin Personnel, LLC
Denver, CO · Huntsville, AL · Reston, VA
As the DevSecOps engineer for the flight software team, you will be the expert on how we build and automate that infrastructure. You'll design and run the GitLab CI/CD pipelines, harden the…
Added 5 mins ago
Avionics Operations Engineer III
Blue Origin Personnel, LLC
Space Coast, FL
…Programs (OFP) to the vehicle avionics. As a test/operations engineer, you will ensure the launch vehicle and associated ground systems are integrated and prepared for launch and…
Added 5 mins ago
Sr. Avionics EGSE Engineer
Blue Origin Personnel, LLC
Denver, CO
Blue Origin is seeking a Senior EGSE Engineer to join the Core Systems and Components group. In this role, you will play a critical part in developing, executing, and maintaining test sets…
Added 5 mins ago
Sr ASIC Design Engineer - TeraWave
Blue Origin Personnel, LLC
San Diego, CA · Cupertino, CA
Strong object-oriented programming and scripting skills (Python, TCL, Perl)
Added 6 mins ago
Red Hat OpenShift Cloud Platform Engineer - Top Secret
General Dynamics Information Technology
Saint Louis, MO
…work depends on TS/SCI level cleared Hybrid Cloud Platform Engineer joining our team to support our Intelligence customer in Springfield, VA or St Louis,…
Added 6 mins ago
Research & Development Electrical Engineer
KBR Wyle Services, LLC
Beavercreek Township, OH
Programming Languages: Experience using Python and MATLAB
Added 8 mins ago
Databricks Data Engineer
EXL Talent Acquisition Team
NY
We are looking for a highly experienced Databricks Data Engineer with 8-10 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. The ideal candidate will lead the…
Added 8 mins ago
Lead Databricks Data Engineer
EXL Talent Acquisition Team
NY
Job Description: Lead Databricks Data Engineer
Added 8 mins ago
AT
Senior Hardware Engineer - Cambridge MA
Akamai Technologies, Inc.
Jefferson City, MO
- $121,400 to $218,600 USD / year
As a Senior Hardware Engineer, you will be responsible for:
Added 8 mins ago
AT
Senior II Software Engineer
Akamai Technologies, Inc.
Jefferson City, MO
- $146,400 to $263,600 USD / year
As a Senior II Software Engineer, you will be responsible for:
Added 9 mins ago
A
Senior Data Engineer
ALO
Beverly Hills, CA
- $140,000 to $180,000 USD / year
We are looking for a Senior Data Engineer to build and scale the foundational data platform that powers analytics, real-time decisioning, and operational intelligence across Alo.
Added 9 mins ago
A
Lead Data Engineer
ALO
Beverly Hills, CA
- $180,000 to $220,000 USD / year
We are looking for a Lead Data Engineer to architect, build, and evolve the foundational data platform that powers analytics, real-time decisioning, and operational intelligence across Alo.

EXL Talent Acquisition Team

Lead Databricks Data Engineer

NY, United States

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 30, 2026
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Description: Lead Databricks Data Engineer Job Title: Lead Databricks Data Engineer Experience: 10-12 Years Employment Type: Full-Time

Job Summary We are looking for a highly experienced Lead Databricks Data Engineer with 10-12 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. The ideal candidate will lead the design, development, modernization, and optimization of enterprise-scale data platforms using Databricks Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise, stakeholder management skills, and hands-on experience building scalable cloud-native data ecosystems. The candidate will be responsible for defining data engineering standards, mentoring teams, driving modernization initiatives, and delivering high-performance data solutions that support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities Data Engineering & Architecture

Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
Define enterprise data models, ingestion frameworks, and transformation strategies.
Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
Build and optimize highly scalable Spark and PySpark solutions handling large-volume datasets.
Drive cloud data platform modernization and migration initiatives.

Technical Leadership

Serve as the technical lead for Databricks and Data Engineering programs.
Establish engineering best practices, coding standards, and architecture guidelines.
Conduct architecture reviews, code reviews, and solution assessments.
Mentor and guide Data Engineers, Technical Leads, and junior team members.
Collaborate with Enterprise Architects, Product Owners, Data Scientists, and Business Stakeholders.

Cloud & Platform Engineering

Design cloud-native data solutions on Azure, AWS, or GCP.
Implement secure, scalable, and resilient data architectures.
Optimize costs, performance, reliability, and availability of data platforms.
Lead CI/CD and Infrastructure-as-Code implementation for data workloads.
Define and implement monitoring, observability, and operational excellence practices.

Governance & Data Quality

Establish data governance, lineage, cataloging, and security controls.
Ensure compliance with organizational and regulatory requirements.
Implement data quality frameworks and monitoring solutions.
Collaborate with security and compliance teams to enforce data protection standards.

Stakeholder & Delivery Management

Partner with business leaders to understand strategic data requirements.
Translate business requirements into scalable technical solutions.
Drive delivery planning, risk management, and resource coordination.
Present architecture decisions and technical recommendations to leadership teams.

Required Technical Skills Databricks

Databricks Lakehouse Platform
Databricks Workflows
Delta Lake
Unity Catalog
Structured Streaming
Databricks SQL
Delta Live Tables (DLT)
Databricks Asset Bundles

Big Data Technologies

Apache Spark
PySpark
Spark SQL
Kafka
Real-Time Streaming Architectures
Data Lake & Lakehouse Architectures

Cloud Platforms (Strong Experience in One or More) Azure

Azure Databricks
Azure Data Factory (ADF)
ADLS Gen2
Azure Synapse Analytics
Azure Key Vault
Event Hub

AWS

S3
EMR
Glue
Redshift
Lambda
IAM

GCP

BigQuery
Cloud Storage
Dataflow
Pub/Sub
Composer

Programming

Python
SQL
PySpark
Scala (Preferred)
Shell Scripting

DevOps & Automation

Git
Azure DevOps
GitHub Actions
Jenkins
Terraform
Docker
Kubernetes

Data Warehousing

Dimensional Modeling
Star & Snowflake Schema
Data Vault
Master Data Management
Data Governance Frameworks

Required Experience

12-15 years of overall IT experience.
Minimum 6+ years of hands-on Databricks experience.
7+ years of experience in Spark/PySpark-based data engineering.
Experience designing enterprise-scale Data Lake and Lakehouse solutions.
Strong experience leading large data transformation and modernization programs.
Experience handling structured, semi-structured, and unstructured data processing.
Experience supporting analytics, AI/ML, and reporting ecosystems.
Proven experience managing technical teams and driving architectural decisions.

Preferred Qualifications

Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or related field.
Databricks Certified Data Engineer Professional.
Azure Data Engineer Associate.
AWS Data Analytics Specialty.
Google Professional Data Engineer Certification.
TOGAF or Cloud Architecture certifications are a plus.

Nice to Have

MLOps and AI Engineering exposure.
Snowflake and Databricks integration experience.
Microsoft Fabric exposure.
Data Mesh implementation experience.
Data Governance tools such as Collibra, Alation, or Informatica.
Expertise in Data Quality frameworks such as Great Expectations or Deequ.

Key Competencies

Solution Architecture
Technical Leadership
Stakeholder Management
Program Delivery
Data Strategy & Governance
Team Mentoring & Coaching
Problem Solving & Decision Making
Communication & Executive Presentation Skills
Performance Optimization
Innovation & Continuous Improvement

Technology Classification Technology Tower: Data & AI Practice Area: Data Engineering Primary Skill: Databricks Lakehouse Engineering Secondary Skills: Apache Spark, PySpark, Cloud Data Platforms (Azure/AWS/GCP), Data Architecture, Data Governance, MLOps.

Management of DB Systems, Performance Tuning, Security, Compliance Standards, Graduate with 4 years BS or Professional Degree. 15 - 18 Years

Apply About employer

Report this job