Required Skills & Experience
4+ years of hands-on Data Engineering experience with a proven track record of delivering independently. Strong hands-on experience with streaming technologies: Apache Kafka, Kafka Streams and Google Cloud Pub/Sub. Experience building and operating event-driven data pipelines and cloud-native applications on GCP. Experience with application deployment and release management, including CI/CD pipelines, automated deployments and production releases. Solid understanding of distributed systems: event-driven architectures, messaging patterns, scalability, fault tolerance and monitoring. Production support experience, including troubleshooting streaming pipelines and optimizing performance. Ability to take ownership of complex work with minimal guidance or supervision. Based in or willing to work from Atlanta, GA or Austin, TX. Authorized to work in the United States without current or future visa sponsorship.
Nice to Have Skills & Experience
GCP BigQuery experience. Advanced SQL skills and experience with enterprise-scale data platforms. Agentic AI experience. Experience supporting large-scale enterprise environments. Strong communication and stakeholder management skills. Demonstrated ability to ramp up quickly and contribute to an established team. Interested in a long-term opportunity with the potential to convert to a full-time role with the client.
Job Description
Compensation: $50/hr to $60/hr. Exact compensation may vary based on several factors, including skills, experience and education. Benefit packages for this role will start on the 1st day of employment and include medical, dental and vision insurance, as well as HSA, FSA and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
JOB DESCRIPTION
A Fortune 100 retail client of Insight Global is looking to hire two Data Engineers with strong streaming experience to join their Enterprise Data Warehouse Team. This team supplies all 12 of the company's business units with the data they need to run more efficiently and profitably. The company has a centralized data organization and is Google's largest customer. More than 200 people report to this director, and the teams work with over 170 petabytes of data on Google Cloud. These engineers will focus on real-time data. They'll build, deploy and support event-driven pipelines that ingest and process streaming data across the enterprise using Apache Kafka, Kafka Streams and Google Cloud Pub/Sub. The role covers the full lifecycle: implementation, deployment through CI/CD, production release management and ongoing operational support. We're looking for engineers who take strong technical ownership of their work from build through production. The ideal candidate thinks systemically about computer science instead of just writing code. There are many ways to build a solution. This person understands the trade-offs of each approach, especially for scalability, fault tolerance and reliability, and can explain why they chose one. We want someone with a growth mindset who reflects on their past work and improves on it. The team's goal is to build streaming systems that work as reliably on day 100 as they do on day 1.
Responsibilities:
Design, build and operate real-time event ingestion and stream processing pipelines using Kafka, Kafka Streams and Google Cloud Pub/Sub. Develop event-driven data pipelines and cloud-native applications on Google Cloud Platform. Deploy, configure and manage applications across environments, including CI/CD pipelines, automated deployments and production releases. Apply event-driven architecture and messaging patterns to build scalable, fault-tolerant systems. Set up and maintain monitoring for streaming applications to keep production workloads reliable. Diagnose and fix streaming pipeline issues, tune performance and provide ongoing production support.