We are looking for a Senior Data Engineer to build modern cloud data solutions that strengthen reporting, analytics, and operational decision-making across the organization. This position is based in Bloomington, Minnesota, and focuses on creating dependable, scalable data products that connect manufacturing and business systems. The ideal candidate brings deep experience with Azure-based engineering tools and a practical approach to performance, governance, and collaboration.
Responsibilities:
- Create and enhance cloud-based data pipelines using Azure Databricks, PySpark, Python, SQL, and related Azure technologies to support enterprise data needs.
- Develop efficient ingestion processes for operational and business data sources, including manufacturing, Industrial IoT, quality, supply chain, inventory, and finance systems.
- Establish reusable engineering frameworks and technical standards that improve consistency, maintainability, and delivery speed across data initiatives.
- Build and manage lakehouse environments using Delta Lake and Medallion Architecture, organizing data through Bronze, Silver, and Gold layers.
- Design data structures that support dashboards, advanced analytics, artificial intelligence, and machine learning applications.
- Maintain documentation, metadata, data lineage records, and operational procedures to support reliable platform operations.
- Integrate Databricks with services such as Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, Microsoft Fabric, Power BI, and Azure DevOps.
- Monitor platform performance and resolve production issues by tuning clusters, workflows, and notebooks for reliability, scalability, and cost control.
- Embed data quality checks, governance practices, security controls, and compliant access management into engineering workflows, including role-based access through Unity Catalog.
- Collaborate with business partners, analysts, architects, and fellow engineers while contributing to Agile planning, reviews, and mentorship of entry-level team members.
- Strong hands-on experience with Python, SQL, Apache Spark, and PySpark in data engineering environments.
- Proven background building ETL and ELT pipelines in Azure cloud platforms, including Azure Databricks, Azure Data Factory, and Azure Data Lake.
- Experience designing scalable data solutions that support reporting, analytics, and operational use cases.
- Familiarity with lakehouse concepts, Delta Lake, and layered data architecture approaches for enterprise data platforms.
- Ability to troubleshoot complex data pipeline issues and improve performance, stability, and cost efficiency.
- Working knowledge of data governance, security, privacy, and access control practices in cloud environments.
- Experience partnering with cross-functional stakeholders to translate business needs into practical technical solutions.
- Strong communication, documentation, and collaboration skills, with the ability to support code reviews and mentor less experienced engineers.