REMOTE Senior Data Engineer

Required Skills & Experience

Minimum of 7+ years of relevant work experience Advanced proficiency with at least one major relational database platform, such as PostgreSQL, MySQL, Oracle, or Microsoft SQL Server, including schema design, query optimization, and operational considerations Proven experience architecting efficient, scalable extraction and ingestion processes for large relational datasets Extensive experience designing, integrating with, and troubleshooting REST APIs, including performance and reliability considerations such as pagination, rate limits, retries, timeouts, error handling, versioning, and service dependencies

Nice to Have Skills & Experience

· Experience using Apache Spark or another distributed data-processing framework · Experience using Python dataframe libraries such as Pandas or Polars · Experience designing or supporting reverse ETL workflows · Familiarity with GraphQL APIs · Experience with Elasticsearch or a similar search and analytics platform · Experience with observability platforms such as Prometheus or Grafana

Job Description

Insight Global is seeking a highly skilled and motivated Senior Data Engineer with expertise in PostgresSQL, Python and, Apache Spark. The ideal candidate will play a key role in our data engineering team, working on designing, developing, and maintaining data pipelines to support our data-driven decision-making processes. This is a fully remote, 6 month contract position potential conversion offering a pay range of $60-65/hr based on skills and experience, with benefits provided through Insight Global while on contract.