Data Engineer (Databricks)

As a member of the Data Engineering team, you’ll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade’s Business Intelligence practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft cloud technology and Microsoft experts. Our clients look to us for innovation, which means you’ll have early access to the newest Microsoft technologies so you can master them and stay ahead of the curve.

Together we do what matters.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.

• Build modern data solutions using Databricks and cloud technologies.

• Develop and optimize data transformations using Python, PySpark and SQL.

• Work with Delta Lake and lakehouse architectures to process large volumes of structured and unstructured data.

• Implement data ingestion, transformation, integration, and quality processes.

• Collaborate with Data Architects, Data Scientists, BI specialists, and business stakeholders.

• Apply best practices around data quality, performance, governance, security, and maintainability.

• Participate in international projects, communicating with clients and colleagues in English.

.

• What we’re looking for· Professional experience working as a Data Engineer or in a similar role.

• Hands-on experience with Databricks in production environments.·

• Strong knowledge of Python / PySpark and SQL.

• Experience designing and implementing ETL/ELT pipelines.·

• Knowledge of Delta Lake, Lakehouse architectures, and data modelling.

• Experience with cloud data platforms, ideally Microsoft Azure.

• Familiarity with technologies such as Azure Data Factory, Azure Data Lake Storage, Synapse Analytics or Microsoft Fabric is a plus.·

• Understanding of CI/CD, Git and DevOps practices applied to data solutions.·

• Strong English communication skills, comfortable working in international environments and participating in technical conversations with clients.

Nice to have

• Databricks certifications, such as Databricks Certified Data Engineer Associate or Professional.

• Microsoft Azure data certifications.

• Experience with Unity Catalog and data governance.

• Knowledge of streaming technologies and real-time data processing.

• Previous experience in consulting or client-facing environments

As you bring your skills and abilities to Avanade, you’ll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You’ll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It’s all here, so take a closer look!

We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.

Create a future for our people that focuses on

• Expanding your thinking * Experimenting courageously * Learning and pivoting

Inspire greatness in our people by

• Empowering every voice * Encouraging boldness * Celebrating progress

Accelerate the impact of our people by

• Amazing the client * Prioritizing what matters * Acting as one

Learn more

To learn more about the types of projects our Analytics team works on check out these case studies:

• thyssenkrupp Materials Services uses data to help strike a delicate operational balance

• What matters to SSE Renewables is innovating for a sustainable future

Interested in knowing what’s going on inside Avanade? Check out our blogs:

• Avanade Insights - exchange ideas that drive tomorrow’s innovation

• Inside Avanade - explore what life is like working at Avanade