Data Engineer

Compensation

$

Hours Per Week

40

Number Of Positions

1

Job Description

Critical role designing, developing and maintaining scalable data pipelines, data sets, and systems for the company’s data infrastructure. Will be collaborating with stakeholders to understand data requirements; Develop ETL (Extract, Transform, Load) processes to change raw data into usable formats for analysis, use and cost effectiveness utilizing techniques such as partitioning, indexing, and caching; Design and implement data models to support the business analytical and reporting needs; ensure data integrity, consistency, and performance and identify errors and performance issues; perform data quality checks for accuracy and consistency of data across systems and platforms; Work closely with business analysts/software engineers to understand their data needs and provide technical expertise and support. Document data pipelines, processes, and best practices for knowledge sharing and future reference; Identify and resolve issues to ensure uninterrupted data flow and availability. Relocation/ telecommuting may be required plus travel to various unanticipated client locations within the United States for short and long term assignments.

Languages, skills and tools: Any suitable combination of the following tools: SQL, Python, AWS, Databricks, Apache Airflow, Apache Kafka, Unix, Bash scripting, GitHub, JIRA, PostgreSQL, Tableau, RabbitMQ, Linux, Oracle, SQL Server, StreamSets, Informatica, Teradata, Stotle, Alteryx, Control-M, R, DBT, Spark, AI/ML Frameworks

Education:

Masters degree in Computer Science/Computer Applications/Business Analytics, Engineering (Electronics & Communication/Mechanical/ Civil/ Electronics) Will accept Bachelors degree in Computer Science/Computer Applications/Business Analytics, Engineering (Electronics & Communication/Mechanical/ Civil/ Electronics) plus five (5) years of progressive experience in related fields in lieu of Masters Degree. Will accept foreign education US equivalent.

Place of Work

Hybrid

Requisition ID

DIGI-DE - NSB

Application Email

hr@digipulsetech.com