***Mode of Interview :- Webcam Interview *** Very long term project (initial PO for 1 year, expect to go for 4+ years)Hybrid (3Days per week Onsite) at Raleigh-NC
Job Description:
Key Responsibilities:-
- Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity
- Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
- Collaborate closely with data engineers to design and deliver high-quality data products
- Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
- Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to effectively communicate insights
- Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
- Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
- Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights
Skills/Requirements:-
Skill Required Years
Databricks and PySpark proficiency: hands-on experience working in the Databricks platform and using PySpark for data analysis and transformation. Required 5 Years
Advanced Spark SQL: the ability to write efficient, complex queries to analyze large datasets within Databricks. Required 5 Years
Data visualization and dashboarding:building clear, intuitive dashboards in Power BI and Databricks’ native visualization tools to communicate insight Required 5 Years
Data mapping and modeling: developing detailed mappings that integrate and transform data Required 5 Years
Business requirements and stakeholder collaboration: gathering and developing business requirements Required 5 Years
Data quality and analysis: conducting thorough data analysis Required 5 Years