Data Engineer

Responsibilities & Tasks

\n
• Work with business users to understand business requirements, issues and business and/or client processes
\n
• Hands on coding of data pipelines
\n
• Hands on administration of existing databases and big data systems
\n
• Develop, test, maintain, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards
\n
• Perform quality assurance testing for all work performed
\n
• Prepare required documentation as outlined by departmental standards
\n
• Meet with agile teams as required to define and document application requirements
\n
• Follow project development & deployment process
\n
• Maintain industry standards and best practices
\n
• Maintain security and organization of the companys data
\n
• Provide off-hour support as assigned
\n
• Provide high level estimates for new business requirements/features
\n
• Work with manager to ascertain the companys data requirements
\n
• Install new databases, data pipelines, maintain existing databases and data pipelines
\n
• Design and implement processes and solutions for data distribution and data archiving
\n
• Develop and implement backup and recovery plans to mitigate the possibility of data loss
\n
• Monitor storage space, storage capacity, and system performance
\n
• Identify, analyze and repair data problems as needed
\n

Technical Skills And Experience

\n
• Must have at least 1 year experience in basic-level administration of both data infrastructure and data
\n
• Must have at least 1 year coding experience in Java, Python, R or other equivalent programming language
\n
• Knowledge of SQL, Relation DB, NoSQL DB, Hadoop
\n
• General data-specific concepts, frameworks and processes
\n
• Agile development practices
\n
• Working within an SDLC
\n

Other Skills And Experience

\n
• Cloud experience, such as AWS, GCP or Azure
\n
• Excellent oral and written communication
\n
• Multi-tasking and managing multiple priorities
\n
• Working well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience
\n
• Working in an Agile team environment
\n