> Markdown version of [/jobs/ext/2387404-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2387404-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** RolePlacement - **Location:** London, UK - **Experience:** Expert - **Salary:** £80,000.0 - £100,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Data Analysis, Microsoft Azure, Bash Shell, Big Data, Cloud Computing, Computer Programming, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Systems, Data Warehousing, Relational Databases, Database Design, Apache Hadoop, Apache Hive, Python (Programming Language), Unix Shell, Microsoft SQL Server, Oracle (Applications), Shell Script, Software Engineering, SQL Stored Procedures, SQL Databases, Scripting, Data Storage Technologies, Apache Spark, Vba Programming Language, Build Tools, Data Pipelines - **Published:** August 11, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=1402f2b8fd86d99f ## About the Role We are seeking a dynamic and experienced Lead Data Engineer to spearhead our data infrastructure initiatives and drive innovative data solutions. In this pivotal role, you will lead a talented team of data engineers, architect scalable data pipelines, and ensure the integrity and security of our enterprise data ecosystem. Your expertise will enable data-driven decision-making across the organization, fostering a culture of continuous improvement and technological excellence. If you thrive on solving complex data challenges and possess a passion for building robust systems, this opportunity is for you! This is a hybrid position with 3 days working in the London office., * Deep expertise in Azure cloud services for scalable data storage and processing solutions. * Strong programming skills in Java, Python, VBA, Bash (Unix shell), and Shell Scripting for automation and application development. * Extensive experience with big data frameworks including Hadoop, Spark, Apache Hive, and related tools for processing large datasets efficiently. * Proficiency in designing robust data warehouses using Oracle, Microsoft SQL Server, or similar relational databases. * Solid understanding of database design principles to create optimized schemas supporting analytical workloads. * Excellent analysis skills to interpret complex datasets and derive actionable insights. * Familiarity with ETL tools such as Informatica to streamline data integration workflows. Join us as a Lead Data Engineer to shape the future of our enterprise data landscape! Bring your passion for innovation, your technical mastery across diverse platforms, and your leadership skills to empower teams that transform raw data into strategic assets. Together, we'll build systems that propel our organization forward with agility and precision! ## Description * Lead the design, development, and maintenance of large-scale data pipelines and architectures utilizing technologies such as Hadoop, Spark, and Apache Hive. * Collaborate with cross-functional teams to understand data requirements and translate them into efficient database designs and scalable solutions. * Oversee the integration of diverse data sources including Oracle, Microsoft SQL Server, and cloud platforms like Azure to support analytics and reporting needs. * Develop and optimize SQL queries, stored procedures, and scripts using VBA, Bash (Unix shell), Shell Scripting, Python, and Java to automate processes and enhance system performance. * Ensure data quality, security, and compliance by implementing best practices in database management and governance. * Mentor junior team members in technical skills such as database design, big data processing, and scripting languages. * Drive continuous improvement initiatives by evaluating emerging technologies like Informatica for ETL processes or Spark for real-time analytics. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Old tools, new tricks](https://www.wearedevelopers.com/videos/1916-old-tools-new-tricks) - [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)