Senior Data Engineer - EY wavespace AI & Data CoE
Role details
Job location
Tech stack
Job description
As a Data Engineer at EY wavespace, you will embark on a journey to take a data engineer role to the next level. You will meet with opportunities to engage with cutting-edge technologies and innovative architectures that drive AI and data-driven solutions. Collaborating closely with the AI domain at our CoE, you will confront complex challenges that stretch the limits of what is possible in data engineering, ensuring that your work is not only technically stimulating but also impactful in shaping the future of our clients' businesses., * Design and implement scalable data pipelines using Databricks (PySpark, Delta Lake), Snowflake and/or Microsoft Fabric.
- Build robust ELT/ETL workflows that support batch and streaming data ingestion.
- Implement best practices for data quality, observability, lineage and metadata management.
- Implement and manage data integration processes, ensuring seamless data flow between various systems and platforms.
- Contribute to data modernization initiatives by ensuring that data is AI-ready.
- Conduct data profiling and cleansing activities to ensure high data quality and integrity across all data systems.
- Implement and manage stream systems to enable real-time data processing and analytics.
Requirements
- Bachelor's or master's degree in computer science, Information Technology, Data Science, or any relevant field.
- Proven hands-on experience working with Databricks, Snowflake, Azure in professional setting.
- Experience delivering projects in MS/Databricks environment.
- Familiar with Data Governance, Unity catalog and/or MS Purview.
- Solid programming skills in Python and SQL
- Industry experience in Consulting or financial services is valued.
- Proficiency in English
- Deep understanding of distributed data processing, cloud data architectures and data warehouse principles.
- 3-5 years of relevant experience.
- Strong communication and teamwork, and excellent problem-solving skills.