Senior Data Engineer

LTM

Sheffield, UK

29 days ago

Apply on uk.indeed.com

Prepare application

Role details

Contract type

Internship / Graduate position

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

7 years minimum

Compensation

£135,200.0

Working hours

Regular working hours

Job source

uk.indeed.com

Tech stack

Artificial Intelligence Data Analysis Apache HTTP Server Microsoft Azure Bash Shell Cloud Computing Computer Programming Databases Continuous Integration Data Cleansing Information Engineering Data Integration

+40 more

Extract Transform Load (ETL) Data Transport Utility Data Warehousing Linux Elasticsearch Github Revision Control Systems Identity and Access Management Python (Programming Language) Linux System Administration Log Analysis Nginx Windows PowerShell Power BI Azure Active Directory Ansible Prometheus Kusto Query Language Standard Sql Azure Data Lake Security Information and Event Management SQL Databases Data Streaming Scripting Data Ingestion Azure Data Factory Delivery Pipeline Grafana Azure Powershell Kubernetes Infrastructure Automation Frameworks Storage Technologies Deployment Automation Apache Kafka Spark Streaming Cloud Optimization Terraform Stream Analytics Data Pipelines Databricks

Job description

Design build and maintain largescale data pipelines and ETL workflows across enterprise datasets
Ingest provision and manage raw enriched and curated data assets for analytics platforms
Improve reliability scalability and realtime data ingestion capabilities
Support and enhance cloudbased data ingestion infrastructure and platform services
Acquire transport clean transform and integrate data from internal and external sources
Perform exploratory data analysis and onboard new data sources
Develop automated data engineering workflows and optimize data processing pipelines
Manage data modelling data warehousing data integration and data cataloguing activities
Support realtime analytics and streaming data platforms
Contribute to cloud infrastructure engineering platform operations and production support
Implement cloud cost optimization and platform efficiency improvements
Collaborate with engineering analytics infrastructure and cybersecurity teams
Support DevOps automation monitoring and operational excellence initiatives
Maintain documentation governance standards and operational procedures

Requirements

Experience with SRE principles and Azure DevOps
Strong scripting skills using Bash PowerShell and Azure CLI
Programming experience with Python C Java and objectoriented development
Strong SQL and Kusto Query Language KQL experience
Experience with GitHub source control systems and CICD pipelines
Strong Linux administration and scripting experience
Knowledge of networking operating systems storage technologies and infrastructure fundamentals
Experience in Data Acquisition and CloudBased Data Pipelines
Experience with Data Transport Data Cleaning and Data Integration
Strong Data Engineering pipeline automation productionization and optimization skills
Experience designing and maintaining ETL workflows and largescale data pipelines
Knowledge of Data Warehousing Data Modeling and Data Cataloguing
Experience with RealTime Analytics and Streaming Data Platforms
Cloud Cost Optimization experience
Strong Azure platform knowledge including Azure AD Azure IAM Networking Compute Storage Databases and Containers
Experience with Azure Data Factory Azure Databricks Unity Catalog Azure Functions Azure Logic Apps Azure Monitor Azure Log Analytics Azure Data Lake Synapse Analytics and Power BI
Experience with Kubernetes and CloudNative platforms
Knowledge of Nginx Apache CosmosDB Linux Prometheus Grafana and Elasticsearch
Experience with Infrastructure as Code tools such as Terraform ARM Chef and Ansible
Experience with Azure Event Hubs Kafka and Spark Streaming
Exposure to SIEM and SOAR platforms is advantageous
Experience working in highly regulated enterprise environments is preferred

Skills

Mandatory Skills : Azure, Data Engineering, Data Acquisition, Azure Data Factory, Azure Databricks, ETL, Data Pipelines, Python, SQL, Azure DevOps

About the company

LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI - enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM - a Larsen & Toubro company - owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltimindtree.com/recruitment-fraud-alert