Data Engineer

As a Data Engineer, you'll play a critical role in building and optimising the core data platform that powers Appello's reporting, analytics, and operational intelligence. Sitting within our dedicated data engineering team, you'll help shape and enhance a modern Azure-based architecture centred on Azure Data Lake Storage (ADLS) and Azure Synapse Analytics.

Your focus will be on designing and developing scalable ELT pipelines, curated data models, and efficient SQL-based transformations that ingest, process, and standardise data from multiple business systems into governed lakehouse layers. You'll ensure our data estate is secure, performant, and well-structured, ready to support analytical and operational use cases across the organisation.

This is a fantastic opportunity to work at the heart of our data strategy, enabling innovation and driving a data-driven culture across the business.

What You'll Be Doing:

Data Solutions Development & Management

• Design, build, and maintain Azure Data Lake layers (Bronze/Silver/Gold) and Synapse-based data models.
• Develop and optimise ELT pipelines using Azure services like Synapse Pipelines, Data Factory, Serverless SQL, and Notebooks.
• Build robust ingestion frameworks for batch and incremental data loads across internal and external systems.
• Create and manage Synapse SQL pools (Serverless and Dedicated) for high-performance analytical querying.
• Write efficient SQL to model, cleanse, and transform large datasets at scale.
• Implement metadata, schema, and data quality frameworks to ensure consistency and compliance.
• Version-control all engineering assets using Git and maintain clear technical documentation.

Integration & API Engineering

• Support system integrations via APIs, webhooks, and scheduled data pulls.
• Ensure smooth data movement between operational systems and downstream reporting tools.
• Collaborate with application owners to ensure secure and optimised data exchange.

Governance, Security & Compliance

• Implement and maintain access controls, encryption, and PII protections across ADLS and Synapse.
• Ensure compliance with UK GDPR and internal governance standards.
• Champion data quality, lineage, and engineering best practices across the organisation.

Advisory & Technical Leadership

• Act as a subject matter expert in Azure data engineering, Synapse, and scalable data architecture.
• Provide guidance to analysts, engineers, and business teams on best practices, performance tuning, and optimisation.
• Support operational continuity by responding to business-driven data requirements.

• 5+ years as a Data Engineer or SQL Developer.
• Advanced SQL development and performance tuning on large datasets.
• Hands-on experience with Azure data services (ADLS, Synapse Pipelines/Data Factory).
• Proven ability to design and deliver ELT pipelines and scalable data models.
• Experience ingesting data from multiple systems (APIs, files, databases).
• Working knowledge of data governance, GDPR, and secure handling of PII.

Desirable Experience

• Experience with Synapse Serverless/Dedicated SQL and lakehouse architectures.
• Exposure to Dynamics 365, Node.js, and Python for automation or transformation.
• Familiarity with CI/CD, Git, and Azure DevOps.
• Experience with IoT/telemetry or time-series data ingestion.
• API integration experience (REST/Webhooks)., * Degree in Computer Science, Data Engineering, or equivalent industry experience.
• Strong grounding in SQL, data modelling, and cloud data engineering principles.
• Understanding of UK GDPR and secure handling of PII.
• Bonus: Azure certifications (e.g., DP-203, Azure Data Engineer Associate), training in Synapse, ADLS, or Data Factory.

Skills & Knowledge

• Advanced SQL and performance optimisation.
• Strong knowledge of Azure data services and scalable ELT design.
• Understanding of APIs, ingestion patterns, and integration methods.
• Familiarity with version control (Git) and modern engineering best practices.
• Bonus: Python, Dynamics 365 data structures, lakehouse architecture, CI/CD, and IoT data processing., * Clear communicator, able to explain technical concepts to non-technical audiences.
• Highly organised with strong attention to detail.
• Practical problem-solver with an ownership mindset.
• Proactive, self-motivated, and comfortable working independently or collaboratively.
• Positive attitude and curiosity about modern cloud data engineering patterns.

• We offer you discounts on everything from groceries and shopping through to holidays, insurance, days out, restaurants and more
• 24/7 employee assistance programme with an easily accessible app!
• Family and friends' discounts on our services & products
• Pension Scheme, up to 4% Company matched
• Free on-site parking

This is an exciting time at the Appello group - we are a company on the move and now is a perfect time to join our team. You'll gain exceptional career opportunities and will be part of a company that is continuing to expand.