Senior Databricks Data Engineer- In MN, IA, WI, SD or ND!

Required Skills & Experience

Mid to Senior-level data engineering experience in an Azure environment Strong SQL and python ability Databricks experience (3+ years of recent cloud-based experience) Strong interpersonal and articulate communication skills

Nice to Have Skills & Experience

Health Plan Claims / Finance / Billing experience On prem to cloud migration experience Experience in other technologies related to their tech stack (Azure, PySpark, GitHub, PowerBI, Airflow) Databricks Certification

Job Description

Insight Global is seeking Data Engineers to join a large payer/provider on its health insurance side, supporting a self-insured billing product team.

This person will be responsible to:

• Migrate their on prem data to the cloud, while their Admin Systems team builds an application that will consume and return data to that data lake.
• Design, develop, and implement end-to-end data solutions using Azure Databricks.
• Modify and maintain data pipelines.
• Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.
• Ensure data quality and integrity by implementing data validation and cleansing processes.
• Support data analysts in providing trend reports to employer health plan groups, looking at the claims dollars billed to evaluate, for example, where they are trending upwards in high cost claims/utilization.