Find work in the United States.

A simpler way to find your next job.

Jobs in the United States

25+ jobs

Save this search

Added 3 mins ago
Lead Director Product Membership
CVS Health
Remote, United States
…proprietary HCD analytics platforms), ensuring high system reliability, data integrity, and real-time…
Added 3 mins ago
C
Java Full Stack Engineer with Spring boot/AWS Experience
Cognizant
Salem, OR
- $86,000 to $99,000 USD / year
As a Java Full Stack Engineer with Spring boot/AWS exp, you will make an impact by designing and delivering scalable, cloud-native healthcare payer applications that improve payment…
Added 3 mins ago
C
Java Full Stack Engineer with Spring boot/AWS Experience
Cognizant
Salem, OR
- $86,000 to $99,000 USD / year
As a Java Full Stack Engineer with Spring boot/AWS exp, you will make an impact by designing and delivering scalable, cloud-native healthcare payer applications that improve payment…
Added 3 mins ago
GA
Sr Staff Applications Operations Engineer – Engineering Tools Automation & AI Ops
GE Aerospace
Salem, OR
- $131,000 to $174,000 USD / year
Coach and mentor Applications Operations engineers, building depth in Linux, automation, cloud, and operations practices.
Added 3 mins ago
EG
Cloud Engineer
Eliassen Group
Salem, OR
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 7 mins ago
AI Engineer - Prototyping
Emergence AI
Irvine, CA
…multi-step workflows, and taking action with the verifiability and reliability required for mission-critical…
Added 12 mins ago
EG
Cloud Engineer
Eliassen Group
Topeka, KS
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 22 mins ago
EG
Cloud Engineer
Eliassen Group
Nashville, TN
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 39 mins ago
Senior Software Developer
Altamira Technology Corporation
Fort Eisenhower, GA
Troubleshoot, debug, and optimize software applications to improve performance, reliability, and scalability
Added 39 mins ago
Senior Software Engineer
The Coca-Cola Company
Atlanta, GA
The Senior Engineer owns how the product is built across all product teams, ensuring sustainable engineering practices that enable teams to move fast without sacrificing quality, security,…
Added 39 mins ago
Senior Manager, Application & Machine Learning Engineer - Fuelight
The Coca-Cola Company
Atlanta, GA
The Senior Manager, Application and Machine Learning Engineer – Fuelight, is a key member of the Product Engineering team within the Digital Product & Engineering organization of the Global…
Added 39 mins ago
Senior Manager, AI & Analytics Engineering
The Coca-Cola Company
Atlanta, GA
Engineer production Python and API services with automated testing, CI/CD, monitoring, and clear operational ownership; design for performance, concurrent demand, reliability, scale, and…
Added 39 mins ago
Lead Full Stack Engineer – Java, Microservices & APIs
U.S. Bank
Atlanta, GA
We are seeking an experienced Lead Software Engineer to provide hands-on technical leadership across the software development lifecycle. This role will lead solution design and development,…
Added 40 mins ago
EG
Cloud Engineer
Eliassen Group
Atlanta, GA
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 59 mins ago
SO
Data Engineer - ITS3 or ITS4
State of Minnesota
St. Paul, MN
- $33.96 to $62.21 USD / hour
Are you passionate about building and optimizing data systems that drive meaningful insights? As a Data Engineer with Minnesota IT Services (MNIT) partnering with Direct Care and Treatment…
Added 59 mins ago
Lead DevSecOps Engineer
Leidos
Eagan, MN
Leidos is seeking a Lead DevSecOps Engineer to join the Air Traffic Business Area within the Homeland Sector, supporting the development of the Leidos Common Automation Platform (L-CAP).…
Added 59 mins ago
DevSecOps Security Engineer
Leidos
Eagan, MN
Leidos is seeking a DevSecOps Security Engineer to join the Air Traffic Business Area within the Homeland Sector, supporting the development of the Leidos Common Automation Platform…
Added 59 mins ago
EG
Cloud Engineer
Eliassen Group
Saint Paul, MN
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 1 hour ago
Sr. Interdisciplinary Systems Engineer / Architect, AWS Bespoke Solutions
Amazon Development Center U.S., Inc.
Jessup, MD
The Bespoke Solutions group in AWS Region Services is looking for a Interdisciplinary Systems Engineer with technical leadership experience leading hardware, software, and FGPA developers…
Added 2 hours ago
Enterprise Applications Manager (AI & Platform Modernization)
Dentons US LLP
Indianapolis, IN
…workflow, endpoint, and productivity platforms in a secure hybrid cloud environment. This leader manages and develops application and endpoint technology professionals, partners with…
Added 2 hours ago
EG
Cloud Engineer
Eliassen Group
Indianapolis, IN
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 2 hours ago
EG
Cloud Engineer
Eliassen Group
Juneau, AK
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 3 hours ago
EG
Cloud Engineer
Eliassen Group
Jackson, MS
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 3 hours ago
EG
Cloud Engineer
Eliassen Group
Charleston, WV
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…
Added 3 hours ago
EG
Cloud Engineer
Eliassen Group
Lincoln, NE
- $70 to $88 USD / hour
Our client seeks a senior Cloud Engineer to own and stabilize a legacy GCP and Azure footprint while assisting with conversions and decommissioning. The role will support automation efforts…

EXL Talent Acquisition Team

Databricks Data Engineer

NY, United States

Full-time

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 30, 2026
Posting language: English
Posted: Nov 5, 2026

Original job description

Job Title: Databricks Data Engineer Experience: 8-10 Years Location: US Employment Type: Full-Time

Job Summary We are looking for a highly experienced Databricks Data Engineer with 8-10 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. The ideal candidate will lead the design, development, modernization, and optimization of enterprise-scale data platforms using Databricks Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise, stakeholder management skills, and hands-on experience building scalable cloud-native data ecosystems. The candidate will be responsible for defining data engineering standards, mentoring teams, driving modernization initiatives, and delivering high-performance data solutions that support analytics, AI/ML, and business intelligence initiatives.

Key Responsibilities Data Engineering & Architecture

Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
Define enterprise data models, ingestion frameworks, and transformation strategies.
Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
Build and optimize highly scalable Spark and PySpark solutions handling large-volume datasets.
Drive cloud data platform modernization and migration initiatives.

Technical Leadership

Serve as the technical lead for Databricks and Data Engineering programs.
Establish engineering best practices, coding standards, and architecture guidelines.
Conduct architecture reviews, code reviews, and solution assessments.
Mentor and guide Data Engineers, Technical Leads, and junior team members.
Collaborate with Enterprise Architects, Product Owners, Data Scientists, and Business Stakeholders.

Cloud & Platform Engineering

Design cloud-native data solutions on Azure, AWS, or GCP.
Implement secure, scalable, and resilient data architectures.
Optimize costs, performance, reliability, and availability of data platforms.
Lead CI/CD and Infrastructure-as-Code implementation for data workloads.
Define and implement monitoring, observability, and operational excellence practices.

Governance & Data Quality

Establish data governance, lineage, cataloging, and security controls.
Ensure compliance with organizational and regulatory requirements.
Implement data quality frameworks and monitoring solutions.
Collaborate with security and compliance teams to enforce data protection standards.

Stakeholder & Delivery Management

Partner with business leaders to understand strategic data requirements.
Translate business requirements into scalable technical solutions.
Drive delivery planning, risk management, and resource coordination.
Present architecture decisions and technical recommendations to leadership teams.

Required Technical Skills Databricks

Databricks Lakehouse Platform
Databricks Workflows
Delta Lake
Unity Catalog
Structured Streaming
Databricks SQL
Delta Live Tables (DLT)
Databricks Asset Bundles

Big Data Technologies

Apache Spark
PySpark
Spark SQL
Kafka
Real-Time Streaming Architectures
Data Lake & Lakehouse Architectures

Cloud Platforms (Strong Experience in One or More) Azure

Azure Databricks
Azure Data Factory (ADF)
ADLS Gen2
Azure Synapse Analytics
Azure Key Vault
Event Hub

AWS

S3
EMR
Glue
Redshift
Lambda
IAM

GCP

BigQuery
Cloud Storage
Dataflow
Pub/Sub
Composer

Programming

Python
SQL
PySpark
Scala (Preferred)
Shell Scripting

DevOps & Automation

Git
Azure DevOps
GitHub Actions
Jenkins
Terraform
Docker
Kubernetes

Data Warehousing

Dimensional Modeling
Star & Snowflake Schema
Data Vault
Master Data Management
Data Governance Frameworks

Required Experience

12-15 years of overall IT experience.
Minimum 6+ years of hands-on Databricks experience.
7+ years of experience in Spark/PySpark-based data engineering.
Experience designing enterprise-scale Data Lake and Lakehouse solutions.
Strong experience leading large data transformation and modernization programs.
Experience handling structured, semi-structured, and unstructured data processing.
Experience supporting analytics, AI/ML, and reporting ecosystems.
Proven experience managing technical teams and driving architectural decisions.

Preferred Qualifications

Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or related field.
Databricks Certified Data Engineer Professional.
Azure Data Engineer Associate.
AWS Data Analytics Specialty.
Google Professional Data Engineer Certification.
TOGAF or Cloud Architecture certifications are a plus.

Nice to Have

MLOps and AI Engineering exposure.
Snowflake and Databricks integration experience.
Microsoft Fabric exposure.
Data Mesh implementation experience.
Data Governance tools such as Collibra, Alation, or Informatica.
Expertise in Data Quality frameworks such as Great Expectations or Deequ.

Key Competencies

Solution Architecture
Technical Leadership
Stakeholder Management
Program Delivery
Data Strategy & Governance
Team Mentoring & Coaching
Problem Solving & Decision Making
Communication & Executive Presentation Skills
Performance Optimization
Innovation & Continuous Improvement

Technology Classification Technology Tower: Data & AI Practice Area: Data Engineering Primary Skill: Databricks Lakehouse Engineering Secondary Skills: Apache Spark, PySpark, Cloud Data Platforms (Azure/AWS/GCP), Data Architecture, Data Governance, MLOps.

Design and implement data pipelines, Optimize data processing and storage, Ensure data solutions meet performance standards, Provide technical support, Collaborate with stakeholders. Bachelor's/Master's in Engineering 5-8 years

Apply About employer

More about this job

Skills

Databricks
Data engineering
Leadership
Stakeholder management
Coaching
ML
Business intelligence
Data models
Unity
Apache Spark
PySpark
Microsoft Azure
AWS
Google Cloud
CI/CD
Infrastructure as code
Cataloging
Regulatory compliance
Data protection
Risk management
SQL
Apache Kafka
Microsoft Azure Data Factory
Google Analytics
EMR
Amazon Redshift
Identity and access management
BigQuery
Python
Scala
DevOps
Git
GitHub
Jenkins
IBM Terraform
Docker
Kubernetes
Data warehousing
Snowflake
Data management

Report this job