Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added just now
O
Software Development Engineer I, Tools
Optimum
Bethpage, NY
- $83,538 to $137,241 USD / year
Optimum Technology Operations & Resilience is looking for a Tools Engineer I to help build and improve internal applications, automations, dashboards, and integrations that support our…
Added 12 mins ago
Software Engineering Lead and Application Architect - TS/SCI with Polygraph
GD Information Technology, Inc.
United States
Partner with Platform/DevSecOps, Security, Data, AI, ServiceNow, Requirements, and Service Operations on lifecycle gates and operational handoff.
Added 12 mins ago
Senior Cloud Platform and DevSecOps Engineer - TS/SCI with Polygraph
GD Information Technology, Inc.
United States
Working knowledge of RMF/STIG controls, change management, operational acceptance, logging/audit, and classified data-handling requirements.
Added 14 mins ago
S
Principal Software Engineer - Observability
Snowflake
Menlo Park, CA
- $264,000 to $379,500 USD / year
The Observability team builds the telemetry, analytics, and diagnostic platform that helps Snowflake customers and engineers understand the health of their workloads and services, detect…
Added 15 mins ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Phoenix, AZ
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 51 mins ago
O
Lead Principal Platform Software Engineer
Oracle
Nashville, TN
- $113,600 to $306,400 USD / year
We are seeking a Lead Principal Software Engineer to set long-term technical direction for the Robotics Automation Platform. You will lead architecture and technical delivery across…
Added 1 hour ago
Senior Site Reliability Engineer
Jobgether
Remote, United States
The Senior Site Reliability Engineer will play a key role in ensuring the reliability, availability, performance, and scalability of enterprise SaaS products. You will help build and…
Added 1 hour ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Honolulu, HI
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 1 hour ago
TL
Vice President, Data Systems
The Los Angeles Lakers, Inc
El Segundo, CA
- $275,000 to $300,000 USD / year
Position Summary: The Vice President, Data Systems will provide strategic and technical leadership for the organization’s data, software engineering, and technology infrastructure,…
Added 1 hour ago
Staff Software Engineer, Fullstack
QXO
Seattle, WA
As a Staff Software Engineer on the QXO RevX Pricing Technology team, you will lead the design, development, and operation of the systems that cost, price, and quote across QXO’s…
Added 1 hour ago
Senior Systems Engineer - FinOps
Marriott
Bethesda, MD
The Senior Systems Engineer – FinOps is a senior technical specialist responsible for driving cloud cost optimization, financial accountability, and engineering-led efficiency across…
Added 1 hour ago
Principal AI/ML Engineer - TS/SCI w/ Poly
Parsons Corporation
Baltimore, MD
Ready for a challenge that puts you at the center of AI innovation for cyber operations? Are you an experienced AI/ML engineer who thrives in a fast-paced environment, enjoys turning…
Added 1 hour ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Annapolis, MD
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 1 hour ago
Senior Platform Engineer
RTI International
UNAVAILABLE
As a Senior Platform Engineer, you will play a key role in building and advancing cloud-native platform capabilities, with a focus on Kubernetes, infrastructure automation, CI/CD,…
Added 1 hour ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Augusta, ME
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 2 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Helena, MT
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 2 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Carson City, NV
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 2 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Concord, NH
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 2 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Providence, RI
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 2 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Baton Rouge, LA
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 2 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Santa Fe, NM
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 2 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Des Moines, IA
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 3 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Bismarck, ND
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 3 hours ago
EG
Staff AI & Data Engineer – Databricks
Eliassen Group
Tallahassee, FL
- $80 to $90 USD / hour
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the…
Added 3 hours ago
EG
Senior Infrastructure Engineer
Eliassen Group
Orlando, FL
- $84 to $86 USD / hour
Our client seeks a Senior Infrastructure Engineer to support and evolve cloud infrastructure powering analytics platforms, optimization engines, and machine learning workloads. The role…

EXL Talent Acquisition Team

Lead Databricks Data Engineer

NY, United States

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 30, 2026
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Description: Lead Databricks Data Engineer Job Title: Lead Databricks Data Engineer Experience: 10-12 Years Employment Type: Full-Time

Job Summary We are looking for a highly experienced Lead Databricks Data Engineer with 10-12 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. The ideal candidate will lead the design, development, modernization, and optimization of enterprise-scale data platforms using Databricks Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise, stakeholder management skills, and hands-on experience building scalable cloud-native data ecosystems. The candidate will be responsible for defining data engineering standards, mentoring teams, driving modernization initiatives, and delivering high-performance data solutions that support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities Data Engineering & Architecture

Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
Define enterprise data models, ingestion frameworks, and transformation strategies.
Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
Build and optimize highly scalable Spark and PySpark solutions handling large-volume datasets.
Drive cloud data platform modernization and migration initiatives.

Technical Leadership

Serve as the technical lead for Databricks and Data Engineering programs.
Establish engineering best practices, coding standards, and architecture guidelines.
Conduct architecture reviews, code reviews, and solution assessments.
Mentor and guide Data Engineers, Technical Leads, and junior team members.
Collaborate with Enterprise Architects, Product Owners, Data Scientists, and Business Stakeholders.

Cloud & Platform Engineering

Design cloud-native data solutions on Azure, AWS, or GCP.
Implement secure, scalable, and resilient data architectures.
Optimize costs, performance, reliability, and availability of data platforms.
Lead CI/CD and Infrastructure-as-Code implementation for data workloads.
Define and implement monitoring, observability, and operational excellence practices.

Governance & Data Quality

Establish data governance, lineage, cataloging, and security controls.
Ensure compliance with organizational and regulatory requirements.
Implement data quality frameworks and monitoring solutions.
Collaborate with security and compliance teams to enforce data protection standards.

Stakeholder & Delivery Management

Partner with business leaders to understand strategic data requirements.
Translate business requirements into scalable technical solutions.
Drive delivery planning, risk management, and resource coordination.
Present architecture decisions and technical recommendations to leadership teams.

Required Technical Skills Databricks

Databricks Lakehouse Platform
Databricks Workflows
Delta Lake
Unity Catalog
Structured Streaming
Databricks SQL
Delta Live Tables (DLT)
Databricks Asset Bundles

Big Data Technologies

Apache Spark
PySpark
Spark SQL
Kafka
Real-Time Streaming Architectures
Data Lake & Lakehouse Architectures

Cloud Platforms (Strong Experience in One or More) Azure

Azure Databricks
Azure Data Factory (ADF)
ADLS Gen2
Azure Synapse Analytics
Azure Key Vault
Event Hub

AWS

S3
EMR
Glue
Redshift
Lambda
IAM

GCP

BigQuery
Cloud Storage
Dataflow
Pub/Sub
Composer

Programming

Python
SQL
PySpark
Scala (Preferred)
Shell Scripting

DevOps & Automation

Git
Azure DevOps
GitHub Actions
Jenkins
Terraform
Docker
Kubernetes

Data Warehousing

Dimensional Modeling
Star & Snowflake Schema
Data Vault
Master Data Management
Data Governance Frameworks

Required Experience

12-15 years of overall IT experience.
Minimum 6+ years of hands-on Databricks experience.
7+ years of experience in Spark/PySpark-based data engineering.
Experience designing enterprise-scale Data Lake and Lakehouse solutions.
Strong experience leading large data transformation and modernization programs.
Experience handling structured, semi-structured, and unstructured data processing.
Experience supporting analytics, AI/ML, and reporting ecosystems.
Proven experience managing technical teams and driving architectural decisions.

Preferred Qualifications

Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or related field.
Databricks Certified Data Engineer Professional.
Azure Data Engineer Associate.
AWS Data Analytics Specialty.
Google Professional Data Engineer Certification.
TOGAF or Cloud Architecture certifications are a plus.

Nice to Have

MLOps and AI Engineering exposure.
Snowflake and Databricks integration experience.
Microsoft Fabric exposure.
Data Mesh implementation experience.
Data Governance tools such as Collibra, Alation, or Informatica.
Expertise in Data Quality frameworks such as Great Expectations or Deequ.

Key Competencies

Solution Architecture
Technical Leadership
Stakeholder Management
Program Delivery
Data Strategy & Governance
Team Mentoring & Coaching
Problem Solving & Decision Making
Communication & Executive Presentation Skills
Performance Optimization
Innovation & Continuous Improvement

Technology Classification Technology Tower: Data & AI Practice Area: Data Engineering Primary Skill: Databricks Lakehouse Engineering Secondary Skills: Apache Spark, PySpark, Cloud Data Platforms (Azure/AWS/GCP), Data Architecture, Data Governance, MLOps.

Management of DB Systems, Performance Tuning, Security, Compliance Standards, Graduate with 4 years BS or Professional Degree. 15 - 18 Years

Apply About employer

Report this job