Sr GCP Data Engineer
- Austin, TX, United States
Applications open in a new tab.
Job details
- Experience
- 6+ years of data engineering experience
- Posting language
- English
- Posted
Original job description
Benefits:
- 401(k)
Senior Data Platform Engineer Onsite Austin, TX
Job Description
We are hiring a Senior Data Platform Engineer for an onsite role in Phoenix, AZ. This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.
Key Responsibilities:
- Design and maintain Airflow DAGs for production data workflows
- Develop and optimize Spark / PySpark jobs on Dataproc
- Build and optimize complex SQL transformations
- Develop REST APIs using FastAPI Python to support data services
- Implement robust data quality and validation frameworks
- Monitor pipeline performance, retries, and SLA compliance
Required Skills:
- 6+ years of data engineering experience
- Strong Python programming skills
- Production experience with Apache Spark PySpark
- Experience with Airflow DAG development
- Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
- Experience building APIs using FastAPI
- Strong SQL and data modeling knowledge
- Experience implementing data quality checks (schema validation, row count checks, anomaly detection)
More about this job
Skills
- Google Cloud
- Apache Airflow
- Apache Spark
- PySpark
- SQL
- API development
- Python
- Regulatory compliance
- Data engineering
- BigQuery
- Data modelling
- Statistical quality control