Data Engineer
- Remote, United States
Applications open in a new tab.
Job details
- Experience
- 15+ years of experience designing and building Star Schema and dimensional data warehouse solutions, including fact and dimension table design.
- Posting language
- English
- Posted
Original job description
Hunton Group is seeking to fill a hands-on Data Engineer to design, build, and maintain our enterprise data platform using Microsoft Fabric. This role will lead the development of a scalable Lakehouse and Warehouse architecture that integrates data from Microsoft Dynamics GP/WennSoft, Salesforce.com, Excel and CSV files, SQL Server, APIs, and other enterprise data sources.
The Data Engineer will work closely with Power BI Analysts and Business Analysts to transform business requirements into reliable, governed, and high-performing data structures that support enterprise reporting, self-service analytics, and future AI and advanced analytics initiatives.
Key Responsibilities
• Design, build, and maintain Microsoft Fabric Lakehouse and Warehouse that serve as the centralized foundation for enterprise reporting and analytics.
• Design and implement Star Schema data models, including fact and dimension tables, optimized for Power BI, analytics, and self-service BI.
• Develop scalable data architecture using Microsoft Fabric, OneLake, Lakehouse, Warehouse, and Delta tables, selecting the appropriate technology and storage pattern for each workload.
• Build and maintain data ingestion and transformation processes using Fabric Data Factory Pipelines, Dataflow Gen2, notebooks, SQL, and other Fabric-native capabilities.
• Integrate data from multiple enterprise sources, including Microsoft Dynamics GP/WennSoft, Salesforce.com, SQL Server, Excel and CSV files, APIs, and other operational systems.
• Design appropriate Bronze, Silver, and Gold data layers to separate raw source data, standardized and cleansed data, and business-ready analytical data.
• Develop robust transformation processes for data cleansing, validation, standardization, and deduplication
• Standardize business logic, KPIs, key metrics, and data definitions across source systems to establish a consistent and trusted enterprise data foundation.
• Design and implement incremental and delta-loading strategies, including CDC, and other techniques to improve data freshness while minimizing unnecessary processing.
• Evaluate and implement appropriate Fabric ingestion patterns, including Pipelines, Mirroring, Shortcuts, Dataflow Gen2, notebooks, and SQL-based transformations.
• Leverage Microsoft OneLake to centralize enterprise analytical data and reduce unnecessary movement and duplication of data.
• Implement comprehensive data quality and reconciliation controls, including completeness, accuracy, duplicate detection, referential integrity, source-to-target balancing, and load validation.
• Implement processes for data lineage, metadata management, auditability, and monitoring across the Fabric environment.
• Maintain technical documentation including data dictionaries, source-to-target mappings, data flows, transformation logic, dependencies, business rules, and architecture documentation.
• Ensure Fabric solutions align with organizational data governance, security, naming, workspace, development, deployment, and master data management standards.
• Optimize Lakehouse, Warehouse, and SQL workloads for performance, scalability, efficient data processing, and large data volumes.
• Collaborate closely with Power BI Analysts to ensure Fabric data structures effectively support Power BI semantic models, Direct Lake, Import, and DirectQuery, selecting the appropriate architecture based on performance and reporting requirements.
• Support the development of centralized, reusable semantic models that provide consistent dimensions, measures, KPIs, and business logic across Power BI reports.
• Implement Git/source control and deployment practices for Microsoft Fabric artifacts to support controlled development, testing, documentation, and production releases.
• Design and implement operational processes for pipeline monitoring, logging, error handling, retries, notifications, reconciliation, and troubleshooting.
• Document end-to-end data lineage and dependencies, from source systems through Fabric Lakehous and Warehous to Power BI semantic models and reporting.
• Build the Microsoft Fabric platform with future capabilities in mind, including AI, machine learning, Copilot, real-time analytics, and other advanced analytics use cases.
Qualifications
Required Skills & Experience
- 15+ years of experience designing and building Star Schema and dimensional data warehouse solutions, including fact and dimension table design.
- Deep SQL and T-SQL expertise, with extensive experience designing, developing, and optimizing enterprise data warehouse solutions.
- Hands-on experience with Microsoft Fabric, SQL Server, or comparable modern cloud data platforms, with the ability to transition traditional data warehouse architectures into Fabric.
- Experience designing and building Microsoft Fabric Lakehouse and Warehouse architectures, including OneLake-based data storage and analytical data structures.
- Strong ETL/ELT experience using Microsoft Fabric Data Factory Pipelines, Azure Data Factory, SSIS, Dataflow Gen2, SQL, or similar data integration technologies.
- Proven experience integrating data from enterprise systems including WennSoft/Dynamics GP, Salesforce.com, SQL Server, Excel and CSV files, APIs, and other operational data sources.
- Strong understanding of dimensional modeling, surrogate keys, Slowly Changing Dimensions (Type 1 and Type 2), incremental loading, data quality, reconciliation, and metadata management.
- Experience implementing scalable Bronze, Silver, and Gold data architecture patterns within modern data platforms.
- Experience documenting source-to-target mappings, data lineage, transformations, data dependencies, and business rules.
- Experience collaborating closely with Power BI Analysts and Business Analysts to translate reporting and analytical requirements into reliable, reusable data structures.
Preferred Qualifications
- Experience with Microsoft Fabric OneLake, Lakehouses, Warehouses, Delta tables, Data Factory Pipelines, Dataflow Gen2, Mirroring, and Shortcuts.
- Familiarity with Power BI semantic models and Direct Lake, with an understanding of how Fabric data architecture and Star Schema design affect Power BI performance.
- Familiarity with Git/source control and deployment practices for Microsoft Fabric development.
- Experience establishing enterprise data quality, governance, lineage, auditing, and monitoring standards.
- Strong documentation, problem-solving, communication, and cross-functional teamwork skills.
More about this job
Skills
- Microsoft Dynamics GP
- Microsoft Excel
- Microsoft SQL Server
- Microsoft Power BI
- Reporting
- Data models
- SQL
- Documentation
- Data management
- Process data
- Git
- Troubleshooting
- Machine learning
- Data warehouse
- Data storage
- Data engineering
- Microsoft Azure Data Factory
- SQL Server Integration Services
- Auditing
- Problem solving
- Communication skills
- Teamwork