Required:

• At least 4 years of experience in building and managing data pipelines
• At least 4 years of experience working on a highly collaborative development team
• At least 2 years of experience with python
• At least 2 years of experience with cloud computing using AWS services
• At least 2 years of experience processing data using spark
• At least 2 years of experience with an RDBMS (Postgres, Oracle, MySQL) and writing SQL queries
• At least 2 years of experience with Linux and shell scripting
• At least 2 years of experience analyzing data in different file formats like csv, xml, json, avro, parquest, etc.
• At least 2 years of experience writing unit tests
• FSP

Desired:

• 2+ years of experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines
• 2+ years of experience with java or scala
• 2+ years of experience administering an EMR/Spark cluster
• 2+ years of experience conducting performance tuning of a spark job
• 2+ years of experience supporting Hive, Iceberg, or another technology providing SQL access to data
• 2+ years of experience developing cloud-based security solutions
• 2+ years of experience following a configuration management process to review and deploy code as part of releases

2 openings