Find work in the United States.

6,202,818 jobs across our US network. How we count

Jobs in the United States

25+ jobs

Save this search

Added just now
Software Engineer (Apps) 4
WEX
Remote, United States
We are seeking a seasoned Sr. Software Engineer in the WEX Mobility Engineering organization. This role will sit in the Mobility team that caters to fleet management and mobility payments…
Added just now
TT
Senior Forward Deployed Engineer
True Talent Solutions Partners
Redwood City, CA
- $215,000 to $290,000 USD / year
- Design and build voice AI solutions, applying effective LLM prompting techniques.
Added 3 mins ago
IT Controls Engineer
Corning Incorporated
Newton, NC
The IT Controls Engineer supports the design, implementation, and continuous improvement of manufacturing control systems and operational technology across both Trivium manufacturing…
Added 4 mins ago
Sr. Associate Design Engineer
Caterpillar, Inc.
Sanford, NC
Caterpillar’s Building Construction Products division in Sanford, NC is hiring a Senior Associate Design Engineer in the Compact Track Loaders (CTL) and Skid Steer Loader (SSL)…
Added 4 mins ago
Principal Engineer, Automation Engineering -Aseptic Filling SME
J&J Family of Companies
Wilson, NC
The Automation Engineer will serve as the subject matter expert (SME) for the integrated aseptic vial and syringe filling lines for Project Eagle in Wilson, North Carolina. This role…
Added 4 mins ago
Principal/Sr Principal Systems Engineer
Northrop Grumman
Morrisville, NC
…at all levels of total system product to include: concept, design, test, installation, operation, and maintenance. The Systems Engineer will lead the engineering of a family-wide software…
Added 4 mins ago
Electrical Controls Engineer
BorgWarner Inc.
Hendersonville, NC
We are looking for an experienced and driven Electrical Controls Engineer to participate in the design, development, and optimization of advanced control systems for our industrial…
Added 4 mins ago
Sr AI Information Security Engineer (REMOTE)
Insight Global
Cary, NC
A large software and gaming company is seeking a Senior Information Security Engineer with hands-on experience in both Security Engineering and AI technologies. This individual will help…
Added 4 mins ago
Platform Engineering Lead Job Details | Black & Veatch Family of Companies
Black & Veatch
Cary, NC
…work. You chair the Technical Governance Board (TGB), guide design decisions across ITSM, ITOM, SecOps, IRM, ITAM (SAM/HAM), and SPM, and keep the platform stable, secure, and ready for…
Added 4 mins ago
Software Engineer
Teledyne
Durham, NC
Assist with software design, architecture, and implementation across a diverse set of projects that include: advanced research, mobile applications, platform technologies (~45%)
Added 4 mins ago
O
Associate Support Engineer
Oracle
Raleigh, NC
- $21.3 to $45.05 USD / hour
…experienced peers to report and support the resolution of routine design, reliability, and maintenance issues. Maintains service request and/or product documentation and learns to create…
Added 4 mins ago
O
Senior Core Infrastructure Engineer - Nashville, TN
Oracle
Raleigh, NC
- $79,200 to $209,500 USD / year
System Design & Architecture - System Scalability:
Added 4 mins ago
AWS Connect Developer
ASM Research, An Accenture Federal Services Company
Raleigh, NC
…The developer also maintains technical documentation, guides implementation decisions, and mentors junior…
Added 4 mins ago
Senior Infrastructure Security Engineer - CASB and DSPM
Prudential Ins Co of America
Newark, NJ
We are looking for a motivated Senior Infrastructure Security Engineer to support the design, implementation and operation of data security controls across cloud and SaaS environments. This…
Added 5 mins ago
Senior AWS Cloud Engineer
Serco
Raleigh, NC
We are seeking a highly skilled and experienced AWS Cloud Engineer to join our IT Operations organization and contribute to the ongoing development of our cloud-native platform.This role…
Added 5 mins ago
Sr Software Engineer (HashiCorp Vault)
IBM
Raleigh, NC
We're looking for a seasoned engineer to design, build, and operate HashiCorp Vault as a service. You'll be responsible for secure, highly available, and compliant secrets management…
Added 5 mins ago
Senior Network Engineer
Cognizant
Raleigh, NC
Cognizant is seeking a Senior Network Engineer to design, implement, secure, operate, and optimize enterprise datacenter, campus, branch, wireless, and hybrid-cloud networks. This role…
Added 5 mins ago
Mainframe Technical Engineer
Highmark Health
Raleigh, NC
Collaborate on the design and implementation of with architecture to ensure solution alignment to enterprise goals and standards
Added 5 mins ago
Software Engineer
Teradata
Raleigh, NC
This position is for a Software Engineer in the POD Services team within the TD Factory team. The position involves development, integration, functional and performance testing, and fault…
Added 5 mins ago
Substation Protection and Controls Engineer - (South)
Leidos
Charlotte, NC
We are looking for a Substation Protection & Control Engineer to join our team in our Substation South Group. As a Protection & Control Engineer, candidates will have the opportunity to…
Added 5 mins ago
Senior Repair Lifing Engineer
Siemens Energy
Charlotte, NC · Rural Hall, NC
…turbine blade and its damage mechanisms. The Repair Lifing Engineer will analyze, simulate, re-design and optimize the blade; from home, at the office or occasionally directly on the shop…
Added 5 mins ago
EC
Lead Manufacturing Engineer, Capacity Expansion
Eaton Corporation
Charlotte, NC · Arden, NC
- $97,000 to $143,000 USD / year
Eaton’s ES AMER ARS division is currently seeking a Lead Manufacturing Engineer, Capacity Expansion based near any of the following Eaton locations: Charlotte, NC, Asheville/Arden, NC, or…
Added 9 mins ago
RC
Full Stack Engineering Intern - Summer 2027
Raft Company Website
McLean, VA
- $20 to $24 USD / hour
Conduct research to support software feature design and implementation.
Added 12 mins ago
Senior Software Engineer, Platform Engineering
Columbia Sportswear Comp
Portland, OR
As a Senior Software Engineer on the Platform Engineering team, you will design, build, and support enterprise integration and platform solutions that connect critical business systems and…
Added 12 mins ago
Manufacturing Engineer
John Deere
Waterloo
Lead implementation of new products and current product Continuous Improvement running design changes

EXL Talent Acquisition Team

Lead Databricks Data Engineer

NY, United States

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 30, 2026
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Description: Lead Databricks Data Engineer Job Title: Lead Databricks Data Engineer Experience: 10-12 Years Employment Type: Full-Time

Job Summary We are looking for a highly experienced Lead Databricks Data Engineer with 10-12 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. The ideal candidate will lead the design, development, modernization, and optimization of enterprise-scale data platforms using Databricks Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise, stakeholder management skills, and hands-on experience building scalable cloud-native data ecosystems. The candidate will be responsible for defining data engineering standards, mentoring teams, driving modernization initiatives, and delivering high-performance data solutions that support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities Data Engineering & Architecture

Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
Define enterprise data models, ingestion frameworks, and transformation strategies.
Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
Build and optimize highly scalable Spark and PySpark solutions handling large-volume datasets.
Drive cloud data platform modernization and migration initiatives.

Technical Leadership

Serve as the technical lead for Databricks and Data Engineering programs.
Establish engineering best practices, coding standards, and architecture guidelines.
Conduct architecture reviews, code reviews, and solution assessments.
Mentor and guide Data Engineers, Technical Leads, and junior team members.
Collaborate with Enterprise Architects, Product Owners, Data Scientists, and Business Stakeholders.

Cloud & Platform Engineering

Design cloud-native data solutions on Azure, AWS, or GCP.
Implement secure, scalable, and resilient data architectures.
Optimize costs, performance, reliability, and availability of data platforms.
Lead CI/CD and Infrastructure-as-Code implementation for data workloads.
Define and implement monitoring, observability, and operational excellence practices.

Governance & Data Quality

Establish data governance, lineage, cataloging, and security controls.
Ensure compliance with organizational and regulatory requirements.
Implement data quality frameworks and monitoring solutions.
Collaborate with security and compliance teams to enforce data protection standards.

Stakeholder & Delivery Management

Partner with business leaders to understand strategic data requirements.
Translate business requirements into scalable technical solutions.
Drive delivery planning, risk management, and resource coordination.
Present architecture decisions and technical recommendations to leadership teams.

Required Technical Skills Databricks

Databricks Lakehouse Platform
Databricks Workflows
Delta Lake
Unity Catalog
Structured Streaming
Databricks SQL
Delta Live Tables (DLT)
Databricks Asset Bundles

Big Data Technologies

Apache Spark
PySpark
Spark SQL
Kafka
Real-Time Streaming Architectures
Data Lake & Lakehouse Architectures

Cloud Platforms (Strong Experience in One or More) Azure

Azure Databricks
Azure Data Factory (ADF)
ADLS Gen2
Azure Synapse Analytics
Azure Key Vault
Event Hub

AWS

S3
EMR
Glue
Redshift
Lambda
IAM

GCP

BigQuery
Cloud Storage
Dataflow
Pub/Sub
Composer

Programming

Python
SQL
PySpark
Scala (Preferred)
Shell Scripting

DevOps & Automation

Git
Azure DevOps
GitHub Actions
Jenkins
Terraform
Docker
Kubernetes

Data Warehousing

Dimensional Modeling
Star & Snowflake Schema
Data Vault
Master Data Management
Data Governance Frameworks

Required Experience

12-15 years of overall IT experience.
Minimum 6+ years of hands-on Databricks experience.
7+ years of experience in Spark/PySpark-based data engineering.
Experience designing enterprise-scale Data Lake and Lakehouse solutions.
Strong experience leading large data transformation and modernization programs.
Experience handling structured, semi-structured, and unstructured data processing.
Experience supporting analytics, AI/ML, and reporting ecosystems.
Proven experience managing technical teams and driving architectural decisions.

Preferred Qualifications

Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or related field.
Databricks Certified Data Engineer Professional.
Azure Data Engineer Associate.
AWS Data Analytics Specialty.
Google Professional Data Engineer Certification.
TOGAF or Cloud Architecture certifications are a plus.

Nice to Have

MLOps and AI Engineering exposure.
Snowflake and Databricks integration experience.
Microsoft Fabric exposure.
Data Mesh implementation experience.
Data Governance tools such as Collibra, Alation, or Informatica.
Expertise in Data Quality frameworks such as Great Expectations or Deequ.

Key Competencies

Solution Architecture
Technical Leadership
Stakeholder Management
Program Delivery
Data Strategy & Governance
Team Mentoring & Coaching
Problem Solving & Decision Making
Communication & Executive Presentation Skills
Performance Optimization
Innovation & Continuous Improvement

Technology Classification Technology Tower: Data & AI Practice Area: Data Engineering Primary Skill: Databricks Lakehouse Engineering Secondary Skills: Apache Spark, PySpark, Cloud Data Platforms (Azure/AWS/GCP), Data Architecture, Data Governance, MLOps.

Management of DB Systems, Performance Tuning, Security, Compliance Standards, Graduate with 4 years BS or Professional Degree. 15 - 18 Years

Apply About employer

Report this job