Lead Data Engineer/Architect
- Warrenville, MI, United States
Applications open in a new tab.
Job details
- Posting language
- English
- Posted
Original job description
IO Datasphere, Inc. has been providing project management, software development and IT staff augmentation services to our clients in the Midwest and throughout the U.S. since 1996. We are an approved vendor on contract to provide software development and IT staff augmentation services for the States of Illinois, Michigan, Minnesota, Iowa, and Wisconsin. We also provide these services to businesses, as well as local and county governments, in the Midwest and nationwide. # Our client is looking a Data Engineer to lead excels in data modeling, Lakehouse and Medallion Architecture concepts, and data/ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including Spark, Kafka, Kubernetes, SageMaker, DBT, Juniper Notebooks, Docker, SQL, and visualization tools such as Power BI/Tableau with the following track record: Tasks - Data Engineering Lead excels in data modeling, Lakehouse, and ML products delivery using an agile DevOps framework with a mastery of distributed data architectures essential for data, analytical and operational ML applications with demonstrated proficiency in frameworks including DataBricks, Sagemaker, Spark, Kafka, Kubernetes, SQL, NoSQL DBs, Graph DBs, and visualization tools such as Power BI/Tableau. - Serve as the primary State of Michigan technology lead engaging with the UoM proof of concept team to support best practice adoption within the state hosting environment and provides training to DAV data engineers. - Oversee the design, development, and maintenance of data pipelines that move, transform, and prepare data for analytics and operational systems. - Architect and optimize data infrastructure, including storage solutions, orchestration frameworks, and ETL/ELT processes. - Ensure data quality, reliability, and security by establishing standards, monitoring systems, and implementing validation and governance practices. - Lead and mentor data engineering staff, providing technical guidance, reviewing designs/code, and supporting professional growth. - Collaborate with cross functional partners, such as data scientists, analysts, product teams, and business stakeholders, to ensure data solutions meet organizational needs and strategic goals. ###### Knowledge, Skills and Abilities Required: - Clear and concise written and verbal communication is crucial to success and productivity in this role NOTE: Candidates must be local to the Lansing Michigan area and those willing to relocate. Candidates that relocate must relocate before day one and be ready to be on-site from day one at their own expense (non-negotiable). Wednesday and Thursday are REQUIRED in-office days. This is NON-NEGOTIABLE and there is NO remote only option. *** *** Location: Lansing, MI Contract: 1 year
More about this job
Skills
- Data modelling
- Apache Spark
- Apache Kafka
- Kubernetes
- Docker
- SQL
- Microsoft Power BI
- Tableau
- Data engineering
- Databricks
- NoSQL
- Communication skills