Technical Lead / Senior Data Engineer

Must Have: Snowflake, DBT, Airflow, Five Tran, Python, Pyspark, Google looker, Expert in SQL optimizations, AWS, and Astronomer

• 10 years’ experience working on cloud data warehouses and data pipelines with a focus on data engineering, building scalable, sustainable, and secure data platforms powering intelligent applications.
• Advanced experience in a Data Engineering or ELT Engineering role.
• Expert-level proficiency in SQL query and stored procedure development.
• Good knowledge on Data Modeling and Designing Architecture diagrams as per requirement.
• Advanced SQL knowledge, including writing complex queries, optimizing performance, and working with large datasets.
• Excellent experience with snowflake and DBT
• Competent with Python, Airflow, GitHub and DAG construction.
• Experience with unstructured datasets and ability to handle Parquet, JSON, AVRO and XML file formats
• Strong understanding of CI/CD principles, DevOps practices, software testing and quality
• Hands-on Experience with cloud-based data engineering and storage technologies such as AWS and orchestration tools such as Apache Airflow Astronomer.
• Advanced experience implementing data quality initiatives, monitoring, and auditing.
• Oversee the design and development of interactive and engaging data visualizations and report using tools such as Looker, Tableau, Power BI, or custom visualization libraries.
• Ensure adherence to best practices, including principles of clarity, accuracy, governance, and effectiveness.

Good to have: Tableau, Power BI, Docker.