REMOTE Data Engineer

Required Skills & Experience

• 3+ years of progressively complex related experience
• Knowledge in Java, Python, PySpark Pig, MySQL or NoSQL or similar
• Strong collaboration and communication skills within and across teams.
• Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources towards Data Integration and Data Quality processes
• Ability to understand complex systems and solve challenging analytical problems
• Experience with bash shell scripts, UNIX utilities & UNIX Commands
• Strong knowledge of large-scale search applications and building high volume data pipelines
• Ability to communicate technical ideas and results to non-technical clients in written and verbal form
• Proven ability to create innovative solutions to highly complex technical problems. Ability to understand and build complex systems and solve challenging analytical problems. Advanced knowledge on Cloud Architecture.
• Work experience on GCP or Azure ecosystems.
• Work experience on building CICD enabled pipelines. Advanced knowledge in BigQuery, Cloud Storage, DataProc, Airflow, Kafka, Spanner, Cloud Shell, Composer, HDFS, Python, Hive, Spark, MySQL or NoSQL or similar.
• Experience in Implementing Machine Learning models, automation and Tableau is preferred. 3 or more years of progressively complex related experience.
• Experience in RT data ingestion and API/Microservice design & development

Job Description

We are in search of a Data Engineer who will be responsible for successful delivery of large-scale cloud based applications. You will design data marts and data models to support Data Science and other internal customers. Responsible for developing and implementing large & complex initiatives involving multiple projects. As a member of the Data and Analytics organization, you will be responsible for designing, building, and maintaining best-in-class data engineering pipelines aimed at driving best-in-class solutions primarily using Cloud platforms like GCP(or Azure). You will collaborate with cross-functional teams, including data scientists, analysts, business SME’s and software engineers, to ensure the efficient and reliable processing, storage, and retrieval of data.

Develops large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs Writes ETL (Extract / Transform / Load) processes, designs database systems and develops tools for real-time and offline analytical processing Collaborates with data science team to transform data and integrate algorithms and models into automated processes Uses knowledge in Data architecture and experience designing & optimizing queries to build data pipelines Uses strong programming skills in Python, Java or any of the major languages to build robust data pipelines and dynamic systems Builds data marts and data models to support Data Science and other internal customers. Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards Analyzes current information technology environments to identify and assess critical capabilities and recommend solutions Experiments with available tools and advice on new tools in order to determine optimal solution given the requirements dictated by the model/use case

Compensation:

$55-60/hour

Exact compensation may vary based on several factors, including skills, experience, and education.

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.