We are looking for a Databricks Solutions Architect to help shape and deliver modern data platforms in Minneapolis, Minnesota. This role focuses on translating business goals into scalable data architecture, guiding stakeholders on the value of Databricks, and designing high-performing solutions across cloud and hybrid environments. The ideal candidate brings deep expertise in data engineering, platform design, and optimization, along with the ability to influence strategy through clear technical communication.
Responsibilities:
- Partner with business and technical stakeholders to define data architecture roadmaps that support organizational priorities using Databricks and related technologies.
- Evaluate current data environments across cloud, on-premises, and legacy platforms to identify gaps, improvement opportunities, and modernization strategies.
- Design target-state data solutions using established architectural best practices with a focus on scalability, resilience, security, and cost efficiency.
- Lead the migration of data workloads, pipelines, and platforms from existing environments into Databricks-based architectures.
- Build and refine data pipelines for ingestion, transformation, cleansing, and integration to ensure reliable delivery of trusted data.
- Improve the performance of existing data platforms by tuning queries, restructuring pipelines, and enhancing data models for better business outcomes.
- Oversee the architecture and optimization of data warehouses and modern data platforms that support analytics and reporting needs.
- Establish and support governance, cataloging, and access management practices, including the use of Unity Catalog and related controls.
- Collaborate with engineering teams on deployment automation, version control, and operational practices aligned with DevOps and DataOps principles.
- Communicate technical recommendations through clear data storytelling and solution presentations that help guide customer and leadership decisions.
- Strong hands-on experience designing and delivering Databricks solutions in enterprise data environments.
- Advanced knowledge of Apache Spark and PySpark, with the ability to develop and optimize large-scale data processing workloads.
- Proven background in ETL development, data integration, and data pipeline architecture.
- Experience working with Azure Data Lake, Azure Pipelines, and Git within cloud-based data ecosystems.
- Deep understanding of data modeling techniques, including relational, dimensional, and semantic design approaches.
- Knowledge of data security, governance, and platform administration practices that support stable and compliant operations.
- Ability to assess existing architectures and create modernization plans for cloud, hybrid, or legacy data platforms.
- Exposure to data science or machine learning initiatives is considered a plus.