Lead Data Engineer

EXL

Remote

In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster

At least 5 years of solid production quality coding experience in data pipeline implementation in Python

Experience working with public cloud platforms, preferably AWS

Experience working with Databricks and/or Snowflake

Experience in Git, JIRA, Jenkins, shell scripting

Familiarity with Agile methodology, test-driven development, source control management and test automation

Experience supporting and working with cross-functional teams in a dynamic environment

You have excellent collaborative problem solving and communication skills and are empathetic to others

You have a track record of building fast, reliable, and high-quality data pipelines