Lead Data Engineer
Role details
Job location
Tech stack
Requirements
-
Very Strong technical developer ( Pyspark, Python, DBX, Azure DE stack (ADF, Logic apps, devOps - CI/CD)).
-
Preferably Databricks or Microsoft certified Engineer (advanced level certifications)
-
Hands on person, should be able to write code as he needs to work on complex user stories. Architecture -
-
Very good at understanding and has ability to implement published common data architecture patterns in Azure. Tech leadership -
-
Ability to lead and guide junior team members in programming & code deployment activities.
-
Participate in engineering discussions and lead discussions into constructive actionable, tangible task items.
-
Identify and highlight engineering and business risks at right moments, propose mitigation plans.
-
Participate in engineering - product scrum discussions and help prioritize, document user stories, and look after deliverables. Requirements
-
8+ years of overall industry experience specifically in data engineering
-
Strong knowledge of data engineering principles, data integration, and data warehousing concepts.
-
Should have MLops and Data Science knowledge.
-
CPG/FMCG domain experience preferred
-
Solid understanding of ETL processes and tools and the Azure cloud platform.
-
Strong programming skills in Python, SQL, or Scala.
-
Good understanding of data modeling, data architecture, and database design.
-
Should have exposure to technologies such as dbt, Apache airflow and Snowflake.
-
Experience extracting/querying/joining large data sets at scale
-
A desire to work in a collaborative, intellectually curious environment
-
Strong communication and organizational skills
Benefits & conditions
This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.