Data Engineering Lead

Job Title: Lead AWS Data Engineer

New Jersey - Newark area​

Job Description

We are seeking a Lead AWS Data Engineer to drive data engineering architecture, pipeline development, and technical delivery using AWS native services, Python, and PySpark. The role involves building scalable data products, modernizing enterprise data platforms, and providing technical leadership to data engineering teams.

Key Responsibilities

• Lead the design and development of scalable data pipelines using AWS Glue, EMR, S3, Python, and PySpark.
• Drive enterprise data integration, ETL/ELT workflows, and data product development.
• Define engineering standards and conduct design and code reviews.
• Optimize pipeline performance, data quality, and processing scalability.
• Guide and mentor Data Engineers while collaborating with architecture, technology, and business teams.

Requirements

Required Skills

• Strong experience in AWS Data Engineering, S3, Glue, and EMR.
• Proficiency in Python, PySpark, SQL, and ETL/ELT.
• Expertise in data pipeline design, optimization, and enterprise data integration.
• Experience in technical leadership, code reviews, and team mentoring.

Preferred Skills

• Experience with Amazon Redshift, Athena, and DynamoDB.
• Knowledge of Apache Iceberg and data lake/lakehouse architecture.
• Experience with domain-oriented data products and authoritative data sources.
• Exposure to large-scale enterprise data modernization.

Benefits

Exavalu also promotes flexibility, adapting to the needs of employees, customers, and the business. It might be part-time work, working outside normal 9-5 business hours or working remotely. We also offer a welcome back program to help individuals return to the mainstream after a prolonged absence due to health or family reasons.

At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, colour, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.