Data Engineer
Role details
Job location
Tech stack
Job description
TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.
- Build strong relationships with a diverse range of stakeholders.
- Gain access to endless learning opportunities.
- Work closely with the range of teams within the business to bring products to life., As a Principal Data Engineer, you will be responsible for the technical design, engineering quality, and delivery of data ingestion, integration, transformation, and data product pipelines. The ideal candidate will bring deep expertise in AWS cloud-native data platforms, Snowflake, and modern data engineering practices, with proven experience in banking and insurance domains., * Lead the design and development of data ingestion, integration, and transformation frameworks.
- Architect and deliver data products that are modular, reusable, and aligned with business domains.
- Ensure technical accountability for detailed design, engineering quality, and delivery of all data engineering solutions.
- Drive continuous improvement in engineering processes to enhance efficiency, production stability, and ROI.
- Manage and own the technical debt process, ensuring long-term maintainability and scalability.
- Collaborate with ML and GenAI teams to operationalize models into production pipelines.
- Ensure observability, data quality, lineage, and governance across the data lifecycle.
- Mentor and lead a team of engineers, fostering a culture of innovation and technical excellence.
Requirements
- Deep hands-on experience with AWS Cloud-native data platforms, including:
- AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch
- AWS SDKs, Boto3, and serverless architecture patterns
- Strong programming skills in Python and Apache Spark
- Proven experience in Snowflake data engineering, including:
- Snowflake SQL, Snowpipe, Streams & Tasks, and performance optimization
- Integration with AWS services and orchestration tools
- Expertise in data integration patterns, ETL/ELT, and data pipeline orchestration
- Experience with data quality frameworks, metadata management, and data lineage
- Hands-on experience with machine learning pipelines and generative AI engineering
- Familiarity with DevOps practices, CI/CD for data workflows, and infrastructure-as-code (e.g., Terraform, CloudFormation).
- Proven track record of delivering data engineering solutions in banking and/or insurance environments.
- Deep understanding of financial data models, regulatory compliance, and risk and fraud analytics.
- Experience working with cross-functional teams in regulated, data-sensitive environments.
Desirable skills:
- AWS Certified Solutions Architect - Professional or equivalent
- Experience with data mesh, data product thinking, or domain-driven design
- Exposure to real-time data processing (e.g., Kinesis, Kafka)
- Experience in highly regulated industries such as banking or insurance
Benefits & conditions
TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.