Data Engineer

Tata Consultancy Services Ltd
Charing Cross, United Kingdom
18 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 81K

Job location

Charing Cross, United Kingdom

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Computer Programming
Continuous Integration
Information Engineering
ETL
DevOps
Python
Machine Learning
Meta-Data Management
Performance Tuning
SQL Databases
Data Ingestion
Snowflake
Spark
Boto3
Technical Debt
Cloudformation
Data Lineage
Amazon Web Services (AWS)
Real Time Data
Kafka
Data Management
Cloudwatch
Terraform
Data Pipelines
Serverless Computing
Redshift

Job description

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

  • Build strong relationships with a diverse range of stakeholders.
  • Gain access to endless learning opportunities.
  • Work closely with the range of teams within the business to bring products to life., As a Principal Data Engineer, you will be responsible for the technical design, engineering quality, and delivery of data ingestion, integration, transformation, and data product pipelines. The ideal candidate will bring deep expertise in AWS cloud-native data platforms, Snowflake, and modern data engineering practices, with proven experience in banking and insurance domains., * Lead the design and development of data ingestion, integration, and transformation frameworks.
  • Architect and deliver data products that are modular, reusable, and aligned with business domains.
  • Ensure technical accountability for detailed design, engineering quality, and delivery of all data engineering solutions.
  • Drive continuous improvement in engineering processes to enhance efficiency, production stability, and ROI.
  • Manage and own the technical debt process, ensuring long-term maintainability and scalability.
  • Collaborate with ML and GenAI teams to operationalize models into production pipelines.
  • Ensure observability, data quality, lineage, and governance across the data lifecycle.
  • Mentor and lead a team of engineers, fostering a culture of innovation and technical excellence.

Requirements

  • Deep hands-on experience with AWS Cloud-native data platforms, including:
  • AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch
  • AWS SDKs, Boto3, and serverless architecture patterns
  • Strong programming skills in Python and Apache Spark
  • Proven experience in Snowflake data engineering, including:
  • Snowflake SQL, Snowpipe, Streams & Tasks, and performance optimization
  • Integration with AWS services and orchestration tools
  • Expertise in data integration patterns, ETL/ELT, and data pipeline orchestration
  • Experience with data quality frameworks, metadata management, and data lineage
  • Hands-on experience with machine learning pipelines and generative AI engineering
  • Familiarity with DevOps practices, CI/CD for data workflows, and infrastructure-as-code (e.g., Terraform, CloudFormation).
  • Proven track record of delivering data engineering solutions in banking and/or insurance environments.
  • Deep understanding of financial data models, regulatory compliance, and risk and fraud analytics.
  • Experience working with cross-functional teams in regulated, data-sensitive environments.

Desirable skills:

  • AWS Certified Solutions Architect - Professional or equivalent
  • Experience with data mesh, data product thinking, or domain-driven design
  • Exposure to real-time data processing (e.g., Kinesis, Kafka)
  • Experience in highly regulated industries such as banking or insurance

Benefits & conditions

TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

About the company

Tata Consultancy Services UK&I is committed to meeting the accessibility needs of all individuals in accordance with the UK Equality Act 2010 and the UK Human Rights Act 1998. We believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity and inclusion motto is 'Inclusion without Exception'. Our continued commitment to Culture and Diversity is reflected across our workforce implemented through equitable workplace policies and processes. You'll find a welcoming culture and many internal volunteering and social networks to join (these are optional). Our diversity, inclusion and social activities include 12 employee networks such as gender diversity, LGBTQIA+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events and we sponsor the London Marathon.

Apply for this position