Data Engineer - 1668
- Santa Monica, CA, United States
Up to $92.5 USD / hour
Applications open in a new tab.
Job details
- Pay
- Up to $92.5 USD / hour
- Posting language
- English
- Posted
Original job description
City: Santa Monica, CA/ Burbank, CA or Glendale, CA
Onsite / Hybrid / Remote: Hybrid. Onsite Monday through Thursday. Remote Friday.
Duration: 6 months - Contract to Hire
Rate Range: Up to $92.50/hr on w2
Work Authorization: GC, USC, All valid EADs except OPT, CPT, H1B
Must Have:
- 4+ years of Data Engineering experience.
- Strong SQL skills, including complex joins, window functions, and analytical queries.
- Hands-on production experience with PySpark and/or Spark SQL.
- Databricks experience, including Delta Lake and Unity Catalog.
- Strong understanding of ETL/ELT pipelines, data modeling, and distributed processing.
Responsibilities:
- Develop and maintain ETL/ELT pipelines using Databricks, PySpark, and SQL for marketing acquisition reporting.
- Migrate existing Snowflake SQL scripts and transformations into Databricks Unity Catalog.
- Build ingestion pipelines for external marketing vendor data.
- Perform data parsing, normalization, transformation, and validation.
- Implement data quality checks, monitoring alerts, and issue resolution workflows.
- Troubleshoot pipeline failures and improve processing performance.
- Support SLA monitoring, logging improvements, and pipeline reliability.
- Collaborate with analytics teams to ensure accurate reporting datasets.
- Participate in code reviews, documentation, and engineering best practices.
Qualifications:
- Minimum 4 years of professional Data Engineering experience or equivalent.
- Experience building production pipelines in Databricks.
- Strong understanding of Delta Lake, Unity Catalog, Lakehouse architecture, and data governance.
- Experience with AWS services such as S3, IAM, EC2, Glue, or Lambda.
- Experience with Apache Airflow or similar orchestration tools.
- Experience processing JSON, Parquet, CSV, and other semi-structured data.
- Experience with Git/GitHub, CI/CD, and modern DevOps practices.
Nice to Have:
- Experience migrating SQL transformations from Snowflake to Databricks.
- Experience working with marketing acquisition or advertising data.
- Experience implementing data quality monitoring and pipeline reliability improvements.
More about this job
Skills
- CPT
- Data engineering
- SQL
- PySpark
- Apache Spark
- Databricks
- Unity
- Data modelling
- Reporting
- Snowflake
- Statistical quality control
- Troubleshoot
- Documentation
- AWS
- Identity and access management
- Apache Airflow
- Git
- GitHub
- CI/CD
- DevOps