Data Engineer

We are looking for a Data Engineer to support healthcare-focused data initiatives in Bridgewater, New Jersey. This Long-term Contract position is ideal for someone who enjoys building reliable data pipelines, working with large-scale datasets, and improving the flow of information across technical environments. The role will contribute to scalable data solutions that help teams access, process, and analyze critical business data efficiently.

Responsibilities:

• Design and maintain scalable data pipelines to collect, transform, and deliver data from multiple sources.
• Develop ETL workflows that improve data quality, consistency, and availability for reporting and analytics needs.
• Use Python and Apache Spark to process high-volume datasets and optimize performance across data engineering tasks.
• Work with Hadoop-based environments to manage distributed data processing and storage effectively.
• Integrate streaming and batch data using Apache Kafka to support timely and dependable data movement.
• Partner with analysts, developers, and business stakeholders to translate data needs into practical engineering solutions.
• Monitor pipeline health, troubleshoot processing issues, and implement improvements that increase reliability and efficiency.
• Hands-on experience building data engineering solutions in a detail-oriented environment.
• Strong programming skills in Python for data processing, automation, and pipeline development.
• Practical expertise with Apache Spark for large-scale data transformation and computation.
• Working knowledge of Apache Hadoop and distributed data ecosystem concepts.
• Experience using Apache Kafka for messaging, streaming, or real-time data integration.
• Solid understanding of ETL design, development, and data validation practices.
• Ability to work independently while collaborating effectively with cross-functional teams.