Jobs in the United States

25+ jobs

Save this search

Added 30 mins ago
Senior Associate - Full-Stack AI & Data Engineer
New York Life Insurance Co
New York, NY
Within the Tech, Data, AI, Ventures (TDAV) organization, our work is guided by a shared vision: deploying the power of technology, data, AI and ventures to accelerate sustainable…
Added 42 mins ago
Data Engineer
KBR Wyle Services, LLC
Camarillo, CA
Added 59 mins ago
IS Data Engineer
Ochsner Clinic Foundation
New Orleans Region, LA
This job designs, builds, and maintains data sources and pipelines for consumption by various analyt
Added 59 mins ago
Data Engineer Intern
Firework
San Mateo, CA
Added 1 hour ago
Senior Associate - Full-Stack AI & Data Engineer
New York Life
New York
Within the Tech, Data, AI, Ventures (TDAV) organization, our work is guided by a shared vision: deploying the power of technology, data, AI and ventures to accelerate sustainable…
Added 1 hour ago
EU
Senior Azure Data Engineer (No C2C)
Experis USA
Baltimore, MD
- $71 to $75 USD / hour
Our client, a leading organization in the energy sector, is seeking a Sr. Data Engineer to join their team. As a Sr. Data Engineer, you will be part of the Data Engineering department…
Added 1 hour ago
AI Data Engineer – AI Training Data
Experis USA
Redmond, WA
Our client, Applied Sciences is seeking a Data Analyst 1 to join their team. As a Data Analyst 1, you will be part of the Applied Sciences organization supporting Applied Sciences teams.…
Added 1 hour ago
Data Engineer
Anthropic
San Francisco, CA · New York City, NY · Seattle, WA
Added 1 hour ago
EG
Senior Data Engineer
Eliassen Group
Bismarck, ND
- $101,000 to $161,800 USD / year
Our client seeks a Senior Data Engineer to own the governed transformation layer end-to-end. The role will design and build Snowflake transformation layers, migrate legacy SQL views and…
Added 1 hour ago
Data Engineer - Intermediate
United Services Automobile Asn
United States
Added 2 hours ago
MS
Data Engineer
MATRIX SYSTEMS & TECHNOLOGIES INC
Washington, DC
- $70,000 to $95,000 USD / year
Matrix seeks a Data Engineer with approximately four to eight years of relevant experience to develop and su
Added 2 hours ago
Production Support Data Engineer
Charles Schwab Inc.
Southlake, TX · Austin, TX
Added 2 hours ago
UG
Senior Data Engineer
UnitedHealth Group
Eden Prairie, MN
- $91,700 to $163,700 USD / year
…outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers,…
Added 2 hours ago
P
Senior Data Engineer
Pontera
NY
- $180,000 to $220,000 USD / year
Added 2 hours ago
Enterprise Data Engineer
Riverside Research Institute
Dayton, OH
Enterprise Data Engineer Location US-OH-Dayton ID 2026-4425 Category Engineering Position Type Full Time Salary Riverside Overview Riverside Research is an independent National Security…
Added 2 hours ago
Junior Business Analyst/Data Engineer
Insight Global
Cincinnati, OH
Insight Global is seeking a Junior Business Analyst/Data Engineer for a large financial institution. This resource will be required to work at client's Madisonville location 4x/week.…
Added 2 hours ago
Data Engineer
Nationwide Mutual Insurance Company
Columbus, OH
Data Engineer needed to design, implement, maintain, and support ETL, data warehousing, and enterprise data-integration workflows across relational databases, file systems, and service…
Added 2 hours ago
EG
Senior Data Engineer
Eliassen Group
Columbus, OH
- $101,000 to $161,800 USD / year
Our client seeks a Senior Data Engineer to own the governed transformation layer end-to-end. The role will design and build Snowflake transformation layers, migrate legacy SQL views and…
Added 2 hours ago
BA
Data Engineer, Mid
Booz Allen Hamilton
Aurora, CO
- $61,900 to $141,000 USD / year
…intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when…
Added 2 hours ago
Senior AI Automation Data Engineer
Micron Technology, Inc.
Boise, ID
Micron’s AI Automation and Data Engineering team drives enterprise data strategy and innovation by delivering scalable data platforms that power advanced analytics, artificial intel
Added 3 hours ago
Data Engineer II, Sales Data Services (SDS)
Amazon.com Services LLC
New York, NY · Seattle, WA
Added 3 hours ago
BP
Senior Data Engineer
Brookfield Properties (USA II) LLC
NY
- $160,000 to $180,000 USD / year
Added 3 hours ago
EG
Senior Data Engineer
Eliassen Group
Augusta, ME
- $101,000 to $161,800 USD / year
Our client seeks a Senior Data Engineer to own the governed transformation layer end-to-end. The role will design and build Snowflake transformation layers, migrate legacy SQL views and…
Added 3 hours ago
EG
Senior Data Engineer
Eliassen Group
Helena, MT
- $101,000 to $161,800 USD / year
Our client seeks a Senior Data Engineer to own the governed transformation layer end-to-end. The role will design and build Snowflake transformation layers, migrate legacy SQL views and…
Added 3 hours ago
TH
Senior Data Engineer (Contract)
Teal Health
San Francisco, CA
- $90 to $125 USD / hour

Insight Global

Sr Data Engineer (Azure Databricks)

Woonsocket, RI, United States

Apply About employer

Applications open in a new tab.

Job details

Experience: 5-7+ years of Data Engineering experience building large-scale data platforms
Posting language: English
Posted: Oct 2, 2026

Original job description

Job Description

Design, develop, and deploy Azure Databricks data pipelines using PySpark and Delta Live Tables
Modernize legacy on-prem SQL pipelines into scalable cloud-native Databricks solutions
Build configuration-driven data pipelines using YAML, JSON, and reusable framework patterns
Develop and maintain CI/CD deployment processes for data engineering workflows
Implement and support Medallion Architecture pipelines across Bronze, Silver, and Gold layers
Partner with upstream and downstream teams to ensure data quality, reliability, and scalability
Troubleshoot and resolve production pipeline issues across Databricks and legacy SQL environments
Enhance monitoring, observability, and operational support processes
Support Medicare and payer-focused initiatives involving member, claims, and operational datasets
Follow established architecture standards and engineering best practices to ensure platform consistency and maintainability

Skills and Requirements

5-7+ years of Data Engineering experience building large-scale data platforms
Strong hands-on experience with Azure Databricks, Delta Lake, and Azure Data Lake Storage (ADLS)
Advanced PySpark development experience, including DataFrames, transformations, joins, aggregations, and performance tuning
Experience developing and maintaining Delta Live Tables (DLT) pipelines
Strong SQL background with experience supporting legacy data warehouse environments
Experience migrating SQL-based pipelines to modern Python/PySpark architectures
Experience with Infrastructure as Code (IaC) and Pipeline as Code methodologies
Proficiency with YAML, JSON, and configuration-driven development patterns
Experience automating CI/CD deployments using DevOps pipelines
Strong understanding of Medallion Architecture (Bronze, Silver, Gold)
Experience building ingestion, transformation, and curation pipelines across Bronze, Silver, and Gold layers
Experience troubleshooting, monitoring, and supporting production data pipelines
Familiarity with Databricks Asset Bundles, Unity Catalog, and Delta Lake preferred
Healthcare industry experience preferred
Medicare, payer, member enrollment, or claims data experience strongly preferred Understanding of healthcare data quality, PHI/PII handling, and regulatory requirements preferred

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Apply About employer

Report this job