Data Engineer

Responsibilities & Tasks

• Work with business users to understand business requirements, issues and business and/or client processes
• Hands on coding of data pipelines
• Hands on administration of existing databases and big data systems
• Develop, test, maintain, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards
• Perform quality assurance testing for all work performed
• Prepare required documentation as outlined by departmental standards
• Meet with agile teams as required to define and document application requirements
• Follow project development & deployment process
• Maintain industry standards and best practices
• Maintain security and organization of the companys data
• Provide off-hour support as assigned
• Provide high level estimates for new business requirements/features
• Work with manager to ascertain the companys data requirements
• Install new databases, data pipelines, maintain existing databases and data pipelines
• Design and implement processes and solutions for data distribution and data archiving
• Develop and implement backup and recovery plans to mitigate the possibility of data loss
• Monitor storage space, storage capacity, and system performance
• Identify, analyze and repair data problems as needed

Technical Skills And Experience

• Must have at least 1 year experience in basic-level administration of both data infrastructure and data
• Must have at least 1 year coding experience in Java, Python, R or other equivalent programming language
• Knowledge of SQL, Relation DB, NoSQL DB, Hadoop
• General data-specific concepts, frameworks and processes
• Agile development practices
• Working within an SDLC

Other Skills And Experience

• Cloud experience, such as AWS, GCP or Azure
• Excellent oral and written communication
• Multi-tasking and managing multiple priorities
• Working well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience
• Working in an Agile team environment