Jobs in the United States

25+ jobs

Save this search

Added 2 mins ago
I
•AI/ML CAD Engineer, RTL & Design Verification
Intel
Hillsboro, OR
- $122,440 to $232,190 USD / year
Join a team helping shape the future of high-performance CPU design. As an AI/ML CAD Engineer supporting RTL and Design Verification , you will develop and enhance automation, tools, and…
Added 2 mins ago
AI Engineer II
Deloitte
Portland, OR
…significant impact on our clients' success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics.…
Added 2 mins ago
AI Engineer III
Deloitte
Portland, OR
…significant impact on our clients' success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics.…
Added 2 mins ago
Senior Full Stack Engineer - NBA
Humana
Salem, OR
The Senior Full Stack Engineer builds and evolves the NBA platform's Action Library and Command Center experience, the operational system used by business and program teams to create,…
Added 2 mins ago
Sr. Application Security Engineer
American Express Global Business Travel
Salem, OR
We are seeking an experienced Senior Application Security Engineer to join our team in the corporate travel industry. This remote position requires a unique blend of application development…
Added 2 mins ago
PN
Software Engineer 1
Pacific Northwest National Laboratory
Salem, OR
- $83,100 USD / year
This Software Engineer 1 role will support the development of the EMSL Science Central technology platform with a focus on backend services, data infrastructure, and platform reliability.…
Added 2 mins ago
EG
Senior Data Engineer
Eliassen Group
Salem, OR
- $101,000 to $161,800 USD / year
Our client seeks a Senior Data Engineer to own the governed transformation layer end-to-end. The role will design and build Snowflake transformation layers, migrate legacy SQL views and…
Added 16 mins ago
Senior Software Development Engineer in Test (SDET)
STERIS Corporation
Vernon Hills, IL
While the formal title is Senior Test Automation Engineer, this is fundamentally a Senior Software Development Engineer in Test (SDET) role that requires deep software development expertise…
Added 17 mins ago
Multi-Cloud DevOps Engineer – Kubernetes/OpenShift
CTG
Armonk, NY
CTG is seeking to fill a Multi-Cloud DevOps Engineer – Kubernetes/OpenShift position for our client.
Added 17 mins ago
Salesforce Software Engineer/ Developer
ManpowerGroup
Waterford, NY
SDLC & DevOps: Manage full software development lifecycles across sandboxes and production environments utilizing CI/CD tools (e.g., Git, Jenkins, Bitbucket, Change Sets).
Added 17 mins ago
Cloud Engineer II- AWS
Honeywell Technologies
Pittsford, NY
Do you enjoy working from the customer perspective and diving deep on issues? As a system development engineer, you will be responsible for the overall health of our AWS cloud-based managed…
Added 19 mins ago
MB
Senior Software Engineer - Salesforce, Java
M&T Bank
Buffalo, NY
- $97,100 to $161,800 USD / year
…least one programming language, verified by a lead software engineer. Apply appropriate data structures and algorithms to solve business…
Added 19 mins ago
Senior Full Stack Engineer - NBA
Humana
Albany, NY
The Senior Full Stack Engineer builds and evolves the NBA platform's Action Library and Command Center experience, the operational system used by business and program teams to create,…
Added 19 mins ago
Sr. Application Security Engineer
American Express Global Business Travel
Albany, NY
We are seeking an experienced Senior Application Security Engineer to join our team in the corporate travel industry. This remote position requires a unique blend of application development…
Added 19 mins ago
PN
Software Engineer 1
Pacific Northwest National Laboratory
Albany, NY
- $83,100 USD / year
This Software Engineer 1 role will support the development of the EMSL Science Central technology platform with a focus on backend services, data infrastructure, and platform reliability.…
Added 20 mins ago
Salesforce Developer
MetLife
New York, NY
The Sales Technology Developer is an early-career software and platform engineer who helps build, test, configure, and support Salesforce-based capabilities for the GB360 Sales scaled…
Added 20 mins ago
Cloud Network Security Engineer
BlackRock
New York, NY
The Cloud Network Security Engineer is responsible for automating, designing, implementing, and maintaining secure networking environments across public, private, and hybrid cloud…
Added 20 mins ago
Data Engineer
Deloitte
New York, NY · Jericho, NY · Rochester, NY
…work in a collaborative environment? As an experienced Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands…
Added 20 mins ago
Sr Databricks Data Engineer
Deloitte
New York, NY
…environments, and unlock value through innovation. As a Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that…
Added 20 mins ago
Agentic Delivery Software Engineer III
Deloitte
Rochester, NY · Williamsville, NY · Jericho, NY · New York, NY
As a Software Engineer III on the Customer team, you will advance AI-assisted software delivery, AI agent development, and agentic system implementation by helping teams translate…
Added 20 mins ago
AI Engineer II
Deloitte
New York, NY
…significant impact on our clients' success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics.…
Added 20 mins ago
Lead Integration Engineer II
Deloitte
New York, NY
US-E - Consulting - Lead Integration Engineer II - AI & Engineering/EaaS
Added 20 mins ago
AI Engineer III
Deloitte
New York, NY
…significant impact on our clients' success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics.…
Added 20 mins ago
Consultant (Infrastructure Engineer)
Open Systems Technologies, Inc
NEW YORK, NY
Consultant (Infrastructure Engineer) needed for Open Systems Technologies, Inc. located in New York, NY. Lead the design, deployment, and maintenance of Kafka clusters using DevOps tools…
Added 21 mins ago
Senior Software Engineer
Maybern Solutions, Inc.
NEW YORK, NY

Insight Global

Sr Data Engineer (Azure Databricks)

Woonsocket, RI, United States

Apply About employer

Applications open in a new tab.

Job details

Experience: 5-7+ years of Data Engineering experience building large-scale data platforms
Posting language: English
Posted: Oct 2, 2026

Original job description

Job Description

Design, develop, and deploy Azure Databricks data pipelines using PySpark and Delta Live Tables
Modernize legacy on-prem SQL pipelines into scalable cloud-native Databricks solutions
Build configuration-driven data pipelines using YAML, JSON, and reusable framework patterns
Develop and maintain CI/CD deployment processes for data engineering workflows
Implement and support Medallion Architecture pipelines across Bronze, Silver, and Gold layers
Partner with upstream and downstream teams to ensure data quality, reliability, and scalability
Troubleshoot and resolve production pipeline issues across Databricks and legacy SQL environments
Enhance monitoring, observability, and operational support processes
Support Medicare and payer-focused initiatives involving member, claims, and operational datasets
Follow established architecture standards and engineering best practices to ensure platform consistency and maintainability

Skills and Requirements

5-7+ years of Data Engineering experience building large-scale data platforms
Strong hands-on experience with Azure Databricks, Delta Lake, and Azure Data Lake Storage (ADLS)
Advanced PySpark development experience, including DataFrames, transformations, joins, aggregations, and performance tuning
Experience developing and maintaining Delta Live Tables (DLT) pipelines
Strong SQL background with experience supporting legacy data warehouse environments
Experience migrating SQL-based pipelines to modern Python/PySpark architectures
Experience with Infrastructure as Code (IaC) and Pipeline as Code methodologies
Proficiency with YAML, JSON, and configuration-driven development patterns
Experience automating CI/CD deployments using DevOps pipelines
Strong understanding of Medallion Architecture (Bronze, Silver, Gold)
Experience building ingestion, transformation, and curation pipelines across Bronze, Silver, and Gold layers
Experience troubleshooting, monitoring, and supporting production data pipelines
Familiarity with Databricks Asset Bundles, Unity Catalog, and Delta Lake preferred
Healthcare industry experience preferred
Medicare, payer, member enrollment, or claims data experience strongly preferred Understanding of healthcare data quality, PHI/PII handling, and regulatory requirements preferred

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Apply About employer

Report this job