Senior Data Engineer

Required Skills & Experience

Must-Haves:

• 10+ years of Data Engineering experience
• Microsoft Fabric hands-on experience or strong working knowledge, backed by a strong Azure background in DevOps and Synapse
• Strong Python and PySpark skills with experience using Notebooks
• Advanced SQL, ETL/ELT, data integration, and database optimization experience
• Experience designing and implementing large-scale data warehouses and cloud data architecture

Nice to Have Skills & Experience

Plusses:

• Agentic AI experience within Microsoft Fabric
• Real-time data streaming experience

Job Description

Job Description:

Insight Global is seeking a Senior Consultant in Data Engineering for a top healthcare client. This individual will join a highly technical data engineering team working on advanced Microsoft Fabric and Azure initiatives, with a major focus on optimizing the current Fabric environment. They will work hands-on with Fabric, Azure Synapse, DevOps, Python, PySpark, Notebooks, SQL, and ETL/ELT, while designing and optimizing large-scale data warehouses and cloud data solutions. This is a senior-level individual contributor role where the candidate will be expected to ramp quickly, independently solve complex technical challenges, and bring strong technical confidence to the team. The team is working beyond basic Fabric implementation and is looking for someone who can speak to meaningful projects, use cases, and challenges they have personally worked through.

Day-to-Day:

• Work hands-on within Microsoft Fabric to optimize and advance the current data environment
• Design and implement large-scale data warehouses and cloud infrastructure
• Build and optimize ETL/ELT pipelines using Python, PySpark, and Notebooks
• Optimize database and data-platform performance
• Support Azure migrations and cloud-native data initiatives -Troubleshoot complex technical incidents and lead root-cause analysis
• Partner with stakeholders to translate business requirements into scalable technical solutions
• Support data governance, security, user access, permissions, and regulatory requirements
• Coordinate with the broader data engineering team to implement improvements and resolve issues
• Operate as a senior individual contributor who can ramp quickly and work independently