Senior Data Engineer
- Remote, United States
Applications open in a new tab.
Job details
- Experience
- 7+ years of experience in data engineering, including building and supporting production data pipelines
- Posting language
- English
- Posted
Original job description
- You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across finance, sales, supply chain, marketing and other business functions.
- Your responsibilities will include:
- Developing and maintaining scalable data pipelines and reusable datasets within a Databricks lakehouse environment
- Ingesting, validating, cleaning and transforming structured and unstructured data from multiple sources using Python, PySpark and SQL
- Building data models and reporting datasets that support Tableau and established analytics tools such as Spotfire
- Integrating established data warehouse and reporting systems with modern cloud analytics platforms
- Improving pipeline reliability, data quality and processing performance
- Implementing automated testing, monitoring, documentation and CI/CD practices
- Partnering with analysts, architects, developers and business stakeholders to deliver practical data solutions
- Providing technical guidance, reviewing code and mentoring other data engineer
- 7+ years of experience in data engineering, including building and supporting production data pipelines
- Strong SQL skills and a solid understanding of data modeling, database design and data warehousing
- Hands-on experience with Databricks, Apache Spark and cloud data platforms
- Strong proficiency in Python and PySpark
- Experience developing ETL/ELT pipelines and integrating data from multiple source systems
- Experience preparing reliable datasets for Tableau or comparable business intelligence tools
- Familiarity with source control, automated testing and CI/CD practices
- Ability to troubleshoot complex data issues and optimize pipeline performance
- Strong communication skills and experience collaborating with technical teams and business stakeholders
- Experience with Spotfire, Oracle, Informatica, R or data virtualization preferred
- Databricks certification preferred
More about this job
Skills
- Reporting
- Decision making
- Sales
- Supply chain management
- Databricks
- Cleaning
- Unstructured data
- Python
- PySpark
- SQL
- Data models
- Tableau
- Data warehouse
- Test automation
- Documentation
- CI/CD
- Coaching
- Data engineering
- Data modelling
- Data warehousing
- Apache Spark
- Business intelligence
- Troubleshoot
- Communication skills
- Oracle
- Informatica
- R