Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 1 min ago
Senior Hardware Engineer - Cross Domain Solutions (SME)
CACI International
Fort Meade, MD
Job Title: Senior Hardware Engineer - Cross Domain Solutions (SME)
Added 8 mins ago
Responsible AI Engineer Specialist
Accenture LLP Company
NY
Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, or related technical fields OR equivalent (minimum 12 years) work experience. (If Associate’s Degree, must have…
Added 8 mins ago
Responsible AI Engineer Manager/Senior Manager
Accenture LLP Company
NY
Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, or related technical fields OR equivalent (minimum 12 years) work experience. (If Associate’s Degree, must have…
Added 59 mins ago
CO
Network Engineer - Public Works
City of San Jose
San Jose, CA
- $130,930.8 to $159,279.12 USD / year
The Network Engineer position is an individual contributor role responsible for day-to-day desktop and user support, patch management, system administration, and maintenance. The…
Added 1 hour ago
REMOTE Senior Amazon Connect Engineer
Insight Global
Baltimore, MD
Insight Global is seeking a Senior AWS Amazon Connect Engineer for a top power generation client. This individual will take ownership of the design, implementation, integration,…
Added 3 hours ago
Senior Full Stack Engineer
Vizient
Irving
Integrate applications with internal platforms, APIs, event streams, analytical data platforms, and external enterprise systems.
Added 3 hours ago
Seibi Technician - Production Engineering
Toyota
Liberty, NC
…schedule for said priorities and reporting their status to management…
Added 3 hours ago
Automation Engineer I/II (MES)
Novo Nordisk
Clayton, NC
Configure and support our Manufacturing Execution Systems platform, enabling real time production data capture, automated workflows, equipment configuration, and system integrations to…
Added 3 hours ago
Field Service Engineer-Power Control Equipment - Charlotte
Siemens
Charlotte, NC
At Russelectric®️, a Siemens business, we are dedicated to designing and building custom power control systems and equipment that meet the stringent performance and reliability requirements…
Added 3 hours ago
Telecommunications Engineer 2 - San Antonio, TX
M.C. Dean, Inc
San Antonio, TX
We are seeking a Telecommunications Engineer 2 to join our Security and Electronic Systems (SES) business Unit. As part of (SES) Strategic Business Unit you will be part of a team that…
Added 3 hours ago
Telecommunications Engineer 2 - Tysons, VA
M.C. Dean, Inc
Tysons, VA
We are seeking a Telecommunications Engineer 2 to join our Security and Electronic Systems (SES) business Unit. As part of (SES) Strategic Business Unit you will be part of a team that…
Added 3 hours ago
Telecommunications Specialist 2 (Technical Specialist 2) - Tysons, VA
M.C. Dean, Inc
Tysons, VA
…telecommunications, life safety, automation and controls, audiovisual, and IT systems. Headquarters in Tysons, Virginia, M.C. Dean delivers resilient, secure, and innovative power and…
Added 3 hours ago
Telecommunications Specialist 2 (Technical Specialist 2) - San Antonio, TX
M.C. Dean, Inc
San Antonio, TX
…telecommunications, life safety, automation and controls, audiovisual, and IT systems. Headquarters in Tysons, Virginia, M.C. Dean delivers resilient, secure, and innovative power and…
Added 3 hours ago
Lead Desktop / Client Server Engineer (TS/SCI)
Koniag Government Services
Arlington, VA
Koniag Data Solutions, a Koniag Government Services company, is seeking an experienced Lead Desktop / Client Server Engineer to join our team in Rosslyn, VA. The ideal candidate is a…
Added 3 hours ago
SharePoint Developer
Koniag Government Services
Washington, DC
Koniag Technology Solutions, Inc a Koniag Government Services company, is seeking a Principal Cloud Security Engineer with a Secret security clearance to support KTS and our government…
Added 3 hours ago
Cloud Compliance Officer
Koniag Government Services
Washington, DC
Microsoft Certified: Azure Security Engineer Associate
Added 3 hours ago
AWS Certified Solutions Architect - Associate
Koniag Government Services
Nashville, TN
…and technically skilled AWS Certified Solutions Architect – Associate to support the design, implementation, and optimization of Amazon Web Services (AWS) cloud architecture solutions for…
Added 3 hours ago
AI Security Engineer - Mid
Koniag Government Services
Washington, DC
…Response (EDR), threat intelligence platforms, vulnerability management systems, and SOC operational workflows, ensuring seamless data flows, accurate model inputs, and reliable automated…
Added 3 hours ago
Zscaler Integration Engineer - Mid
Koniag Government Services
Washington, DC
The Zscaler Integration Engineer (Mid) will serve as a contributing technical engineer within the program's network security team, supporting the engineering, implementation,…
Added 3 hours ago
Jr Palo Alto Integration Tech
Koniag Government Services
Washington, DC
…individual supports the protection of Government networks and systems through the monitoring of Palo Alto Networks platform health and security events, execution of routine administrative…
Added 3 hours ago
Palo Alto Integration Engineer - Mid
Koniag Government Services
Washington, DC
…(NGFW) infrastructure across perimeter, internal segmentation, data center, and cloud-attached deployment contexts under the technical guidance of the Senior Palo Alto Integration…
Added 3 hours ago
Senior Application Operations Engineer
Koniag Government Services
Washington, DC
Koniag IT Systems, LLC a Koniag Government Services company, is seeking a Senior Application Operations Engineer to support KITS and our government customer Washington, DC. The position is…
Added 3 hours ago
End-User Computing (EUC) Engineer
Koniag Government Services
Washington, DC
Koniag IT Systems, LLC, a Koniag Government Services company, is seeking an End-User Computing (EUC) Engineer to support KITS and our government customer in Washington, DC. This position…
Added 3 hours ago
GCP Senior Engineer
Koniag Government Services
Washington, DC
The Senior GCP Engineer will serve on a focused, small team to support GCP Cloud service offerings used by a government agency to modernize and migrate systems to the cloud. The Engineer…
Added 3 hours ago
AWS Senior Engineer
Koniag Government Services
Washington, DC
The Senior AWS Engineer will serve on a focused, small team to support AWS Cloud service offerings used by a government agency to modernize and migrate systems to the cloud. The Engineer…

EXL Talent Acquisition Team

Lead Databricks Data Engineer

NY, United States

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 30, 2026
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Description: Lead Databricks Data Engineer Job Title: Lead Databricks Data Engineer Experience: 10-12 Years Employment Type: Full-Time

Job Summary We are looking for a highly experienced Lead Databricks Data Engineer with 10-12 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. The ideal candidate will lead the design, development, modernization, and optimization of enterprise-scale data platforms using Databricks Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise, stakeholder management skills, and hands-on experience building scalable cloud-native data ecosystems. The candidate will be responsible for defining data engineering standards, mentoring teams, driving modernization initiatives, and delivering high-performance data solutions that support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities Data Engineering & Architecture

Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
Define enterprise data models, ingestion frameworks, and transformation strategies.
Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
Build and optimize highly scalable Spark and PySpark solutions handling large-volume datasets.
Drive cloud data platform modernization and migration initiatives.

Technical Leadership

Serve as the technical lead for Databricks and Data Engineering programs.
Establish engineering best practices, coding standards, and architecture guidelines.
Conduct architecture reviews, code reviews, and solution assessments.
Mentor and guide Data Engineers, Technical Leads, and junior team members.
Collaborate with Enterprise Architects, Product Owners, Data Scientists, and Business Stakeholders.

Cloud & Platform Engineering

Design cloud-native data solutions on Azure, AWS, or GCP.
Implement secure, scalable, and resilient data architectures.
Optimize costs, performance, reliability, and availability of data platforms.
Lead CI/CD and Infrastructure-as-Code implementation for data workloads.
Define and implement monitoring, observability, and operational excellence practices.

Governance & Data Quality

Establish data governance, lineage, cataloging, and security controls.
Ensure compliance with organizational and regulatory requirements.
Implement data quality frameworks and monitoring solutions.
Collaborate with security and compliance teams to enforce data protection standards.

Stakeholder & Delivery Management

Partner with business leaders to understand strategic data requirements.
Translate business requirements into scalable technical solutions.
Drive delivery planning, risk management, and resource coordination.
Present architecture decisions and technical recommendations to leadership teams.

Required Technical Skills Databricks

Databricks Lakehouse Platform
Databricks Workflows
Delta Lake
Unity Catalog
Structured Streaming
Databricks SQL
Delta Live Tables (DLT)
Databricks Asset Bundles

Big Data Technologies

Apache Spark
PySpark
Spark SQL
Kafka
Real-Time Streaming Architectures
Data Lake & Lakehouse Architectures

Cloud Platforms (Strong Experience in One or More) Azure

Azure Databricks
Azure Data Factory (ADF)
ADLS Gen2
Azure Synapse Analytics
Azure Key Vault
Event Hub

AWS

S3
EMR
Glue
Redshift
Lambda
IAM

GCP

BigQuery
Cloud Storage
Dataflow
Pub/Sub
Composer

Programming

Python
SQL
PySpark
Scala (Preferred)
Shell Scripting

DevOps & Automation

Git
Azure DevOps
GitHub Actions
Jenkins
Terraform
Docker
Kubernetes

Data Warehousing

Dimensional Modeling
Star & Snowflake Schema
Data Vault
Master Data Management
Data Governance Frameworks

Required Experience

12-15 years of overall IT experience.
Minimum 6+ years of hands-on Databricks experience.
7+ years of experience in Spark/PySpark-based data engineering.
Experience designing enterprise-scale Data Lake and Lakehouse solutions.
Strong experience leading large data transformation and modernization programs.
Experience handling structured, semi-structured, and unstructured data processing.
Experience supporting analytics, AI/ML, and reporting ecosystems.
Proven experience managing technical teams and driving architectural decisions.

Preferred Qualifications

Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or related field.
Databricks Certified Data Engineer Professional.
Azure Data Engineer Associate.
AWS Data Analytics Specialty.
Google Professional Data Engineer Certification.
TOGAF or Cloud Architecture certifications are a plus.

Nice to Have

MLOps and AI Engineering exposure.
Snowflake and Databricks integration experience.
Microsoft Fabric exposure.
Data Mesh implementation experience.
Data Governance tools such as Collibra, Alation, or Informatica.
Expertise in Data Quality frameworks such as Great Expectations or Deequ.

Key Competencies

Solution Architecture
Technical Leadership
Stakeholder Management
Program Delivery
Data Strategy & Governance
Team Mentoring & Coaching
Problem Solving & Decision Making
Communication & Executive Presentation Skills
Performance Optimization
Innovation & Continuous Improvement

Technology Classification Technology Tower: Data & AI Practice Area: Data Engineering Primary Skill: Databricks Lakehouse Engineering Secondary Skills: Apache Spark, PySpark, Cloud Data Platforms (Azure/AWS/GCP), Data Architecture, Data Governance, MLOps.

Management of DB Systems, Performance Tuning, Security, Compliance Standards, Graduate with 4 years BS or Professional Degree. 15 - 18 Years

Apply About employer

Report this job