Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added just now
Substation Project Technical Lead
Stantec
Nashville, TN · Knoxville, TN
…solutions, modernizing the electric grid, and developing natural gas…
Added just now
Regional Sector Lead-Power Delivery
Stantec
Nashville, TN · Chattanooga, TN · Knoxville, TN
…solutions, modernizing the electric grid, and developing natural gas…
Added just now
Protection and Control Substation Technical Lead
Stantec
Nashville, TN · Knoxville, TN
…solutions, modernizing the electric grid, and developing natural gas…
Added just now
IT Operations Engineer - Platform B - 519030
Tennessee Valley Authority
CHATTANOOGA, TN
Maintain the infrastructure to assure compliance with configurations, patches and approved designs. Active participant in the change management process to properly execute change with…
Added just now
K
Structural Engineer - Kiewit Nuclear Solutions - Lenexa, KS, Houston, TX, Knoxville, TN, Itasca, IL
Kiewit
Knoxville, TN
- $115,000 to $120,000 USD / year
…operate in the power utility, renewable energy, industrial, and infrastructure markets. As part of Kiewit, we are integrated with 135 years of construction and engineering excellence that…
Added just now
Operations Performance Engineer
Dow
Knoxville, TN
Dow's Emulsions/Polymers production facility in Knoxville, TN has an opening for an Operations Performance Engineer .
Added just now
Water Resources EIT/Coordinator
HDR
Fort Worth, TX
…directly support public health, environmental sustainability, and infrastructure resilience. We bring together experts across disciplines to solve complex challenges with bold thinking and…
Added just now
Power Delivery Project Engineer
HDR
Honolulu, HI
Experience in power delivery, utility engineering, or related infrastructure
Added just now
Solid Waste EIT
HDR
Honolulu, HI
Working under the supervision of the Area Solid Waste Section Manager and senior engineering staff, the Solid Waste Engineer-in-Training supports the planning, design, permitting, and…
Added just now
Civil Designer / EIT
HDR
Boston, MA
…Engineering Services Group, you’ll help design the critical infrastructure that supports the digital age and shapes the spaces where people work, connect, and thrive. From high-performance…
Added just now
Senior Software Engineer (Institutional, Financing)
Coinbase
Nashville, TN
As a Senior Software Engineer on the Financing Engineering team within the Institutional group, you'll design, build, and scale the systems that safely manage billions of dollars in loans…
Added just now
Associate Software Engineer
Highmark Health
Nashville, TN
This job is an integral member of an agile software engineer team responsible for building scalable software applications across all digital channels to serve our customers. Responsible for…
Added just now
Protection and Control Substation Technical Lead
Stantec
Chicago, IL · Sacramento, CA · Denver, CO · San Diego, CA · Bellevue, WA · Houston, TX · Phoenix, AZ · Salt Lake City, UT · Saint Louis, MO · Atlanta, GA · Knoxville, TN · Nashville, TN · West Palm Beach, FL · Wyomissing, PA · Philadelphia, PA · Portland, ME · Boston, MA · Charleston, SC
This is a senior seller-doer role for an experienced substation protection and control engineer who enjoys leading people, solving complex technical challenges, working directly with…
Added just now
Protection and Control Substation Project Technical Lead
Stantec
North Charleston, SC · Charleston, SC
This is a senior seller-doer role for an experienced substation protection and control engineer who enjoys leading people, solving complex technical challenges, working directly with…
Added just now
Substation Project Technical Lead
Stantec
Chicago, IL · Denver, CO · Sacramento, CA · San Diego, CA · Bellevue, WA · Houston, TX · Phoenix, AZ · Salt Lake City, UT · Saint Louis, MO · Atlanta, GA · Knoxville, TN · Nashville, TN · West Palm Beach, FL · Wyomissing, PA · Philadelphia, PA · Portland, ME · Boston, MA · Charleston, SC
This is a senior seller-doer role for an experienced physical and electrical substation engineer who enjoys leading people, solving complex technical challenges, working directly with…
Added just now
Substation Project Technical Lead
Stantec
North Charleston, SC · Charleston, SC
This is a senior seller-doer role for an experienced physical and electrical substation engineer who enjoys leading people, solving complex technical challenges, working directly with…
Added just now
Regional Sector Lead-Power Delivery
Stantec
West Palm Beach, FL · Atlanta, GA · Jackson, MS · Lake Mary, FL · Mobile, AL · Austin, TX · Houston, TX · Dallas, TX · Fort Worth, TX · New Orleans, LA · Charleston, SC · Chattanooga, TN · Nashville, TN · Knoxville, TN
Added just now
Underground Mining Engineer
Stantec
Chandler, AZ · Phoenix, AZ · Denver, CO · Salt Lake City, UT · Reno, NV
The Underground Mining Engineer will lead mine engineering for mining studies/projects of varying size and complexity, and at various project stages from initial concepts through to…
Added 1 min ago
Director - Customer Response Engineering
Trellix
Nashville, TN
Partner with Technical Support, Customer Success, Product Management, and Engineering so issues reach the right engineer fast and customer feedback reaches the roadmap.
Added 1 min ago
Senior Telecom Engineer
Maximus
Nashville, TN
Maximus is seeking an experienced Senior Telecom Engineer to lead the design, implementation, and optimization of Genesys Cloud solutions. This role is responsible for executing large-scale…
Added 1 min ago
Vice President, Cloud Platform Engineer
SitusAMC
Nashville, TN
…Docker, Kubernetes, and familiar with Git development. The Engineer is expected to provide strategy and implement enterprise-scale automation for scalability, performance, security, and…
Added 1 min ago
Network Operations Engineer
Meta
Nashville, TN
Meta is seeking a Network Operations Engineer to join our Edge and Network Services (ENS) Foundation NetOps team. In this role, you will utilize your knowledge in hyperscale data center…
Added 1 min ago
Mechanical Engineer, Data Center Operations Engineering
Meta
Nashville, TN
Meta is seeking a Mechanical Engineer to join our Data Center Operations Engineering team. Our data centers are the foundation upon which our rapidly growing infrastructure efficiently…
Added 1 min ago
Senior Product Development Engineer - Lenoir City, TN
Hubbell Power Systems
Lenoir City, TN
The Senior Product Development Engineer will lead and execute the technical design and development of new products and processes. This role will develop product concepts/ innovative…
Added 1 min ago
DevSecOps Senior Automation Platform Engineer
CACI
Aberdeen Proving Ground, MD · Aberdeen Proving Ground
Job Title: DevSecOps Senior Automation Platform Engineer

EXL Talent Acquisition Team

Lead Databricks Data Engineer

NY, United States

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 30, 2026
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Description: Lead Databricks Data Engineer Job Title: Lead Databricks Data Engineer Experience: 10-12 Years Employment Type: Full-Time

Job Summary We are looking for a highly experienced Lead Databricks Data Engineer with 10-12 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. The ideal candidate will lead the design, development, modernization, and optimization of enterprise-scale data platforms using Databricks Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise, stakeholder management skills, and hands-on experience building scalable cloud-native data ecosystems. The candidate will be responsible for defining data engineering standards, mentoring teams, driving modernization initiatives, and delivering high-performance data solutions that support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities Data Engineering & Architecture

Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
Define enterprise data models, ingestion frameworks, and transformation strategies.
Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
Build and optimize highly scalable Spark and PySpark solutions handling large-volume datasets.
Drive cloud data platform modernization and migration initiatives.

Technical Leadership

Serve as the technical lead for Databricks and Data Engineering programs.
Establish engineering best practices, coding standards, and architecture guidelines.
Conduct architecture reviews, code reviews, and solution assessments.
Mentor and guide Data Engineers, Technical Leads, and junior team members.
Collaborate with Enterprise Architects, Product Owners, Data Scientists, and Business Stakeholders.

Cloud & Platform Engineering

Design cloud-native data solutions on Azure, AWS, or GCP.
Implement secure, scalable, and resilient data architectures.
Optimize costs, performance, reliability, and availability of data platforms.
Lead CI/CD and Infrastructure-as-Code implementation for data workloads.
Define and implement monitoring, observability, and operational excellence practices.

Governance & Data Quality

Establish data governance, lineage, cataloging, and security controls.
Ensure compliance with organizational and regulatory requirements.
Implement data quality frameworks and monitoring solutions.
Collaborate with security and compliance teams to enforce data protection standards.

Stakeholder & Delivery Management

Partner with business leaders to understand strategic data requirements.
Translate business requirements into scalable technical solutions.
Drive delivery planning, risk management, and resource coordination.
Present architecture decisions and technical recommendations to leadership teams.

Required Technical Skills Databricks

Databricks Lakehouse Platform
Databricks Workflows
Delta Lake
Unity Catalog
Structured Streaming
Databricks SQL
Delta Live Tables (DLT)
Databricks Asset Bundles

Big Data Technologies

Apache Spark
PySpark
Spark SQL
Kafka
Real-Time Streaming Architectures
Data Lake & Lakehouse Architectures

Cloud Platforms (Strong Experience in One or More) Azure

Azure Databricks
Azure Data Factory (ADF)
ADLS Gen2
Azure Synapse Analytics
Azure Key Vault
Event Hub

AWS

S3
EMR
Glue
Redshift
Lambda
IAM

GCP

BigQuery
Cloud Storage
Dataflow
Pub/Sub
Composer

Programming

Python
SQL
PySpark
Scala (Preferred)
Shell Scripting

DevOps & Automation

Git
Azure DevOps
GitHub Actions
Jenkins
Terraform
Docker
Kubernetes

Data Warehousing

Dimensional Modeling
Star & Snowflake Schema
Data Vault
Master Data Management
Data Governance Frameworks

Required Experience

12-15 years of overall IT experience.
Minimum 6+ years of hands-on Databricks experience.
7+ years of experience in Spark/PySpark-based data engineering.
Experience designing enterprise-scale Data Lake and Lakehouse solutions.
Strong experience leading large data transformation and modernization programs.
Experience handling structured, semi-structured, and unstructured data processing.
Experience supporting analytics, AI/ML, and reporting ecosystems.
Proven experience managing technical teams and driving architectural decisions.

Preferred Qualifications

Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or related field.
Databricks Certified Data Engineer Professional.
Azure Data Engineer Associate.
AWS Data Analytics Specialty.
Google Professional Data Engineer Certification.
TOGAF or Cloud Architecture certifications are a plus.

Nice to Have

MLOps and AI Engineering exposure.
Snowflake and Databricks integration experience.
Microsoft Fabric exposure.
Data Mesh implementation experience.
Data Governance tools such as Collibra, Alation, or Informatica.
Expertise in Data Quality frameworks such as Great Expectations or Deequ.

Key Competencies

Solution Architecture
Technical Leadership
Stakeholder Management
Program Delivery
Data Strategy & Governance
Team Mentoring & Coaching
Problem Solving & Decision Making
Communication & Executive Presentation Skills
Performance Optimization
Innovation & Continuous Improvement

Technology Classification Technology Tower: Data & AI Practice Area: Data Engineering Primary Skill: Databricks Lakehouse Engineering Secondary Skills: Apache Spark, PySpark, Cloud Data Platforms (Azure/AWS/GCP), Data Architecture, Data Governance, MLOps.

Management of DB Systems, Performance Tuning, Security, Compliance Standards, Graduate with 4 years BS or Professional Degree. 15 - 18 Years

Apply About employer

Report this job