Required Skills & Experience
- Strong Data Engineering Background Approximately 6+ years of professional data engineering experience, or an equivalent combination of relevant education and experience. Demonstrated experience designing and developing production-grade data pipelines. Strong understanding of data modeling, database design, data warehousing, and data transformation.
- Real-Time Data Pipeline Experience This is the most important technical requirement for the role.
Candidates must have hands-on experience:
Designing and developing real-time or streaming data pipelines. Moving data from source systems through transformation layers into downstream data stores. Building reliable pipelines with considerations around latency, scalability, fault tolerance, and data quality. Candidates who are primarily Analytics Engineers, BI Developers, or dashboard developers without significant real-time pipeline development experience will not be the right fit.
- SQL Advanced hands-on SQL experience.
Ability to write complex, performant queries. Strong understanding of how underlying data connects to business and product metrics.
- Modern Data Stack
Hands-on experience with several of the following:
Kafka Airflow BigQuery dbt Google Cloud Platform (GCP) MongoDB or comparable NoSQL technologies
Nice to Have Skills & Experience
Experience working within GCP, which would reduce the ramp-up required. Experience with MongoDB or another NoSQL database. Experience with Kubernetes. Experience supporting analytics in addition to core data engineering responsibilities. Experience with Looker, Redash, or other BI/dashboarding platforms. Experience writing code in Python, JavaScript, or R. Experience working with clinical trial, healthcare, life sciences, or other highly regulated data. Familiarity with data privacy and compliance requirements such as HIPAA and GDPR.
Job Description
We are seeking an experienced Data Engineer to design, build, and support scalable data pipelines and data warehouse solutions. This role is heavily focused on real-time data engineering, including ingesting, transforming, modeling, and validating data from multiple source systems. The ideal candidate has strong experience building real-time data pipelines, advanced SQL skills, and experience with modern cloud data technologies such as Kafka, Airflow, BigQuery, dbt, and GCP. While this person will support reporting and analytics use cases, this is not primarily an Analytics Engineer or BI role. The team’s largest current need is strong data engineering capability. Candidates who also understand business metrics and analytics will be especially valuable.
Responsibilities
Design, build, test, deploy, and maintain real-time and batch data pipelines. Build reliable, fault-tolerant, low-latency data solutions that move data from source systems into the data warehouse. Develop scalable data models that support downstream analytics, reporting, and customer-facing applications. Write and optimize advanced SQL queries for large datasets and production environments. Work with technologies such as Kafka, Airflow, BigQuery, dbt, and GCP. Integrate structured and unstructured data from multiple sources, including NoSQL environments such as MongoDB. Validate data quality, accuracy, completeness, and reliability throughout the data pipeline. Translate business requirements and metrics into effective data models and datasets. Support analytical use cases and help derive actionable insights from the underlying data. Implement appropriate row-level and column-level security controls. Partner with analytics and product teams to provide data for customer-facing reports and drill-down functionality. Support reporting environments using tools such as Looker, Redash, and internally developed dashboarding tools. Follow appropriate data privacy, security, and compliance practices.
Pay Ray ranges from $24-$25/hr