Data Engineer - Data & Analytics Platforms

As a Senior Data Engineer within Data & Analytics Platforms, you will lead the design and delivery of scalable, reliable data engineering solutions that underpin analytics, data science, and AI use cases across client environments. You will work across modern data platforms, integrations, and pipelines, supporting a wide range of analytical and AI driven projects.

This role focuses on building the data foundations required for advanced analytics and AI, working closely with data scientists and client stakeholders to ensure data is accessible, trusted, and fit for purpose.

Core Responsibilities

• Lead the design and development of robust data pipelines and data platforms to support analytics and AI workloads
• Build and maintain batch and streaming data solutions, including ingestion, transformation, and orchestration
• Design appropriate data models using relational, dimensional, or other modelling techniques, selecting approaches based on the requirements of analytics, reporting, and data science use
• Collaborate across multiple teams and client stakeholders to design and deliver end to end data and AI solutions within the wider client technology
• Work across cloud based data platforms and services (e.g. AWS, Azure, or GCP)
• Design and deliver data solutions that are functionally correct and fit for purpose, while meeting non functional requirements such as security, performance, resilience, and maintainability
• Support and guide junior engineers through technical leadership and mentoring
• Contribute to platform and engineering standards, best practices, and continuous improvement across engagements, IBM wants you to bring your whole self to work and for you this might mean the ability to work flexibly. If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment.

Bachelor's Degree

Required technical and professional expertise

• Strong experience with Python, SQL, and data engineering frameworks or tools
• Proven experience designing and delivering data pipelines and data platforms in a professional environment
• Hands on experience with cloud data services (e.g. Azure Data Factory, Databricks, Synapse, AWS Glue, Redshift, BigQuery, or equivalents)
• Experience working with relational and/or NoSQL databases
• Solid understanding of data modelling, integration patterns, and data quality principles
• Strong problem solving and communication skills, with experience working in multidisciplinary delivery teams

This role is subject to pre-employment screening in line with the UK Government's Baseline Personnel Security Standard (BPSS). An additional range of Personal Security Controls referred to as National Security Vetting (NVS) may apply, this could include meeting the eligibility requirements for The Security Check (SC) or Developed Vetting (DV).

Preferred technical and professional experience

• Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
• Knowledge of data quality and metadata management practices.
• Understanding of data virtualisation and data federation techniques.
• Experience with big data technologies (e.g., Hadoop, Spark).
• Experience supporting analytics, data science, or machine learning use cases
• Exposure to streaming or event driven architectures (e.g. Kafka or equivalent)
• Experience with CI/CD, infrastructure as code, or platform automation
• Background delivering solutions in regulated or security constrained environments such as public sector or financial services, Being an IBMer means you'll be able to learn and develop yourself and your career, you'll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

• Tools and policies to support your work-life balance from flexible working approaches, sabbatical programs, paid paternity leave, maternity leave and an innovative maternity returners scheme
• More traditional benefits, such as 25 days holiday (in addition to public holidays), private medical, dental & optical cover, online shopping discounts, an Employee Assistance Program, life assurance and a group pension plan through salary sacrifice.

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your role and responsibilities