Senior Data Engineer Hybrid

Aptask Global Workforce (AGW) is seeking a Senior Data Engineer for a Hybrid position with a Major Media and Entertainment Company located in New York, NY.As a Senior Data Engineer, you'll join the Content Delivery Engineering team and will be responsible for implementing and maintaining systems that ingest, process, and store vast amounts of data from internal and external partner systems. In this role, you will work with a variety of technologies that support the building of meaningful models, alerts, reports, and visualizations from vast quantities of data. These data systems must be scalable, robust, and within budget.Responsibilities: * Design, develop & maintain new and existing data systems and pipelines, with a focus on reliability, testability and ease of use * Assist in cleansing, discretization, imputation, selection, generalization etc. to create high quality features for the modeling process * Work with business stakeholders to define business requirements including KPI and acceptance criteria * Use big data, relational and non-relational data sources, to access data at the appropriate level of granularity for the needs of specific analytical projects * Maintain up to date knowledge of the relevant data set structures and participate in defining necessary upgrades and modifications * Collaborate with software and data architects in building real-time and automated batch implementations of the data science solutions and integrating them into the streaming service architecture * Ensure a consistent, diligent approach to peer review of code and configuration change within sensible, maintained repository structures and CI/CD pipelined deployment * Participate in, or lead design reviews, architectural discussions and team knowledge sharing sessions with peers and stakeholders * Make best use of our observability systems & advanced analytics to surface issues, drive diagnosis and develop fixesRequirements: * Bachelor's degree in computer science, information technology, or a relevant field is required * 5+ years of experience in working with big data: ETL, pipeline building, analysis and code, with expertise in at least one programming language * Experience implementing scalable, distributed, highly available, and resilient systems using industry standard data platforms (Snowflake, Databricks, GCP, AWS, etc) * Skilled with using software repositories, CI/CD pipelines and test automation * Experience with data visualization tools and techniques * Strong skills in data processing using SQL * Experience with Site Reliability Engineering (SRE) practices for ensuring scalability and reliability in cloud environments * Familiarity with Agile methodologies (Scrum and Kanban) * A flair for communicating clearly via design document, text, voice and code to a wide variety of nationalities * Knowledge and/or production exposure to using CDNs to deliver streaming media is advantageous or full training can be providedDesired skills: * Experience with Snowflake or similar data service * Experience with data visualizations * Experience with multi-billion record datasets and leading projects that span the disciplines of data science and data engineering * Knowledge of enterprise-level digital analytics platforms * Team oriented and collaborative approach with a demonstrated aptitude and willingness to learn new methods and tools * Pride and ownership in your workPay range: $115,000 - $145,000 per yearOnly candidates available and ready to work directly as Aptask Global Workforce (AGW) employees will be considered for this position.If you have the described qualifications and are interested in this exciting opportunity, apply today!Aptask Global Workforce (AGW)ApTask Global Workforce (AGW) is a certified Minority and Veteran workforce solutions company. AGW delivers operational, clinical, lab and professional talent with a strong focus on healthcare and life sc