Azure Data Engineer | Cloud ETL
Role details
Job location
Tech stack
Requirements
ph3About The Job /h3 pAre you passionate about contributing to the development and maintenance of sophisticated data pipelines and infrastructure? Do you embody agility, innovation, and dynamism while demonstrating readiness to execute complex, high-impact projects within cloud-based environments? Are you driven to collaborate with seasoned professionals and engage cross-functionally with diverse business units throughout the organization? Do you excel in both collaborative team settings and autonomous work arrangements, proactively engaging with stakeholders to ensure continuous project advancement? If you find yourself answering affirmatively to these questions, we have a compelling opportunity that aligns with your professional aspirations. /p pOur team oversees the development and maintenance of the financial application suite for Allianz Germany insurance operations. The present project entails architecting advanced data pipelines to aggregate and transform financial data from multiple Allianz business systems for SAP integration, utilizing Microsoft Azure and Databricks platforms. This modernization effort will replace the existing legacy infrastructure built on SAS (Linux-based) and Oracle technologies. /p h3What You Do /h3 ul liCollaborate with team members, with opportunities to lead smaller project components and provide technical guidance to clients and team about potential programming solutions. /li liProgram end-to-end ETL (Extract, Transform, Load) processes in accordance with the architectural framework and procedural specifications established by the project. /li liDesign and deploy requisite landing zones and data repositories to facilitate the ingestion of raw data assets. Develop comprehensive data models for all designated modeling components, including tables, data marts, and associated structures. /li liProgram and orchestrate staging operations leveraging Data Bricks architecture, incorporating robust pipelining mechanisms and systematic processes. /li liEstablish and configure the raw data vault as well as the business data vault. Refactor or incorporate pipelining artifacts into library concept. /li liSet up client-specific data warehouses and data marts within the consumption layer framework (Data Bricks based). /li liIntegrate data from external DBMS sources (e.g. OCI Oracle, AES Snowflake) as well as implementing and deploying complex migration scenarios, using AI-powered tools when appropriate. /li /ul h3What You Bring /h3 ul liBachelor's or Master's degree in Mathematics, (Business) Computer Science, or a comparable qualification, with a proven ability to contribute to complex, enterprise-level IT projects. /li liExtensive proficiency in agile methodologies, techniques, and frameworks, combined with strategic thinking to enable targeted, outcome-focused delivery. /li liConfident, assertive professional demeanor with superior communication skills, a collaborative mindset, and exceptional service orientation toward stakeholders and clients. /li liStrong expertise and hands-on experience with enterprise-grade technologies, including Databricks, Python, PySpark, interactive computational notebooks, GitHub, Azure Functions, and workflow orchestration and automation tools. /li liGood knowledge of cloud-native technologies and enterprise applications within the Microsoft Azure ecosystem, with demonstrated ability to implement scalable cloud-based solutions and cloud-to-cloud interconnectivity architectures. /li liSystematic, analytical approach to problem-solving with the ability to articulate and present complex technical concepts clearly through written documentation, visual formats, and oral communication. /li liAdvanced English language proficiency (Common European Framework Level B or equivalent) and an established track record of successful contributions to multi-year cloud projects. /li liWe welcome candidates with an interest in machine learning. /li /ul h3What We Offer /h3 ul liWe offer a hybrid