Data Engineer

Are you a passionate Data Engineer with a flair for innovation? Do you thrive in a dynamic environment where your skills can shape the future of data architecture? If so, we have the perfect opportunity for you! Our client, a leader in the Utilities sector, is seeking a Senior Data Engineer for a temporary role of 3 months., As a Senior Data Engineer, you will play a pivotal role in enhancing the Interconnectors Data Platform (ICDP), a cloud-based data warehouse essential for commercial, financial modeling, and operational decision-making. With the platform evolving towards a modernized Medallion Architecture and Azure-native ingestion patterns, your expertise will drive architectural direction and technical leadership., Data Architecture & Platform Engineering:

• Lead the design and implementation of scalable data architectures using Bronze/Silver/Gold layered models.
• Shape the platform's architectural roadmap, ensuring alignment with cutting-edge engineering practices.
• Develop secure and observable ingestion and transformation pipelines.

Pipeline Development & Operations:

• Spearhead the migration from legacy ETL tools to modern Azure-based pipelines, using Azure Functions, Azure Data Factory (ADF), and event-driven frameworks.
• Build and maintain high-performance SQL transformations, curated layers, and reusable data models.
• Embed CI/CD, testing, version control, and observability into workflows.

Data Quality & Governance:

• Ensure robust data validation, reconciliation, profiling, and auditability across platform layers.
• Collaborate with business stakeholders to guarantee analytical and operational needs are met.

Leadership:

• Mentor fellow data engineers, fostering technical growth within the ICDP team.
• Collaborate with Product teams, IT&D, and external partners to achieve high-quality outcomes.
• Serve as a technical authority on engineering approaches, patterns, and standards.

Essential Technical Skills:

• Python: Strong hands-on experience in building production-grade data pipelines and orchestration.
• Advanced SQL: Expert-level skills in analytical SQL, query optimization, and data modeling.
• Azure Cloud: Familiarity with Azure Functions, Azure Data Factory, Azure Storage, and cloud security fundamentals.
• Data Warehousing: In-depth understanding of data architecture principles and scalable enterprise data design.
• Version Control: Proficient in Git, CI/CD, automated testing, and modern engineering practices.
• Pipeline Design: Experience with API ingestion, SFTP ingestion, and resilient pipeline design.

Soft Skills:

• Exceptional problem-solving and architectural thinking abilities.
• Strong communication and stakeholder collaboration skills.
• Capability to lead and provide clarity in complex technical environments.

Desirable Experience:

• Involvement in data-platform re-architecture programs.
• Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems.
• Experience in regulated or high-assurance data environments.