JOB DESCRIPTION

The Data Engineer will manipulate data and data flows for both existing and new systems. Additionally, they will provide support in the areas of data extraction, transformation and load (ETL), data mapping, data extraction, analytical support, operational support, database support, and maintenance support of data and associated systems. As a member of the team, candidates will work in a multi-tasking, quick-paced, dynamic, process-improvement environment that requires experience with the principles of large-scale (terabytes) database development, large-scale file manipulation, data modeling, data mapping, data testing, data quality, and documentation preparation.

KEY RESPONSIBILITIES

• Provide support in the areas of data extraction, transformation and load (ETL), data mapping, data extraction, analytical support, operational support, database support, and maintenance support of data and associated systems

• Troubleshoots complex problems and provides customer support for the ETL process

• Develop complex data flows, or makes significant enhancements to existing pipelines.

• Conducts investigations and tests of considerable complexity.

• Researches emerging technologies to determine impact on application execution.

• Provides input to staff involved in writing and updating technical documentation.

• Prepares reports on analyses, findings, and project progress.

• Provides guidance and work leadership to less-experienced software engineers.

• May serve as a technical team or task leader.

EDUCATION AND EXPERIENCE

• Bachelor’s Degree in Computer Science, Electrical or Computer Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience

• 8+ years of related software engineering and ETL experience.

REQUIRED QUALIFICATIONS

• Experience with the following languages: Python, SQL, Elastic Search, XML, XQuery, XPath, HTML/XHTML, CSS, Shell Scripting, JSON, Java/J2EE

• Experience developing and maintaining microservices in a docker/Kubernetes environment

• Experience building and maintaining data flows in NiFi 

• Knowledge of servers operating systems: Linux, windows

DESIRED QUALIFICATIONS

• Strong problem-solving skills

• Focus on continual process improvement with a proactive approach to problem solving

• Ability to follow directions and finish task 

• Excellent organizational, coordination, interpersonal and team building skills