Lead Data Engineer
Role details
Job location
Tech stack
Job description
The Lead Data Engineer will provide technical leadership across the design, development, deployment, and maintenance of scalable data and analytics solutions. The role combines hands-on engineering expertise with team leadership, mentoring and supporting engineers while driving best practices across delivery, architecture, and data engineering standards.
Working closely with business and technical stakeholders, you will translate business requirements into robust technical solutions, delivering enterprise-grade data integration, transformation, and business intelligence solutions. Key responsibilities include data modelling, ETL/data pipeline development, source-to-target mapping, automation, testing strategies, and enabling self-service analytics and reporting capabilities.
This role requires strong experience with Azure, Databricks, and SQL Server, alongside expertise in modern cloud-based data platforms and scalable data architectures. You will play a key role in ensuring solutions are reliable, maintainable, and aligned with business and operational goals.
The successful candidate will demonstrate strong leadership, communication, collaboration, critical thinking, and problem-solving skills, with a passion for innovation, knowledge sharing, and developing high-performing engineering teams
As part of your duties, you will be responsible for:
- Designing, developing, testing, and deploying scalable batch and real-time data integration solutions using Azure, Azure Data Factory, Databricks, SQL Server, Microsoft SSIS, Matillion, Airflow, Sqoop, Hadoop, and NoSQL technologies.
- Creating and maintaining technical documentation including ETL architecture, data integration specifications, testing plans, deployment documentation, and source-to-target mapping.
- Working closely with business and technical stakeholders to gather requirements, perform data analysis, and develop conceptual, logical, and physical data models aligned to business needs.
- Providing technical leadership, mentoring engineers and consultants, and ensuring best practices, delivery standards, training, and development processes are followed across projects.
- Leading the design and delivery of enterprise analytics, reporting, and self-service BI solutions using Power BI, Tableau, Qlik, SQL Server Reporting Services (SSRS), and SQL Server Analysis Services (SSAS).
- Driving scalable, secure, and high-performing data and reporting architectures while staying current with emerging technologies and industry best practices.
Requirements
Do you have experience in Tableau?, Do you have a Master's degree?, * 10 Years industry implementation experience with data integration tools such as Microsoft SSIS, Azure Data Factory, Databricks, Glue, Step Functions, Airflow, Apache Flume/Sqoop/Pig, etc.
- 3-5 years of management experience required
- 3-5 years consulting experience preferred
- Minimum of 5 years of data architecture, data modelling or similar experience
- Bachelor's degree or equivalent experience, Master's Degree Preferred
- Strong data warehousing, OLTP systems, data integration and SDLC
- Strong experience in big data frameworks & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred), Spark Scala or Spark SQL) or Similar, along with experience in libraries / frameworks to accelerate code development
- Experience using major data modelling tools (examples: ERwin, ER/Studio, PowerDesigner, etc.)
- Experience with major database platforms (e.g. SQL Server, Oracle, Azure Data Lake, Hadoop, Azure Synapse/SQL Data Warehouse, Snowflake, Redshift etc.)
- Strong experience in orchestration & working experience in either Data Factory or HDInsight or Data Pipeline or Cloud composer or Similar
- Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.)
- Understanding of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.
- Understanding of on premises and cloud infrastructure architectures (e.g. Azure, AWS, GCP)
- Strong experience in Agile Process (Scrum cadences, Roles, deliverables) & working experience in either Azure DevOps, JIRA or Similar with Experience in CI/CD using one or more code management platforms
- 3-5 years' development experience in decision support / business intelligence environments utilizing tools such as SQL Server Analysis and Reporting Services, Microsoft's Power BI, Tableau, looker etc.
Preferred Experience:
- Strong experience in Data Integration, Data Warehousing, Enterprise Data Management (EDM), and modern cloud/Big Data architectures.
- Ability to analyse business requirements, define data transformation processes, and design scalable reporting and analytics solutions.
- Experience delivering end-to-end Data Integration projects, including estimation, testing, documentation, implementation, and proof of concepts.
- Strong technical leadership skills with experience mentoring teams, guiding data analysis activities, and influencing stakeholders across business and technical communities.
- Proven ability to design effective data models, validate business rules using SQL and BI tools, and deliver scalable, supportable analytic solutions.
- Excellent problem-solving, analytical, communication, and relationship-building skills, with the ability to work independently and collaboratively in fast-paced agile environments.
- Ability to act as a trusted advisor to clients and internal stakeholders, contributing to solution strategy, innovation, and pre-sales activities.
Benefits & conditions
- A competitive salary with a generous bonus, private healthcare, critical illness life assurance at 4 x your annual salary, income protection insurance, and a rewarding pension.
- EXL provides everyday financial well-being solutions, such as cash back cards, in which you can earn cashback while enjoying discounts, promotions, and offers from top retailers. We also offer a Cycle Scheme where you can save money on bikes and cycling accessories.
- At EXL, we are committed to providing our employees with the tools and resources they need to succeed and excel in their careers. We offer a wide range of professional and personal development opportunities. We also support a range of learning initiatives that allow our employees to build on their existing skills and knowledge. From online courses to seminars and workshops, our employees have the opportunity to enhance their skills and stay up to date with the latest trends and technologies.
- As an Equal Opportunity Employer, EXL is committed to diversity. Our company does not discriminate based on race, religion, colour, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, age, or disability status.
- EXL employees are eligible to purchase stock as part of our Employee Stock Purchase Plan (ESPP).
- At EXL, we offer a flexible hybrid working model that allows employees to live a balanced, healthy lifestyle while strengthening our culture of collaboration.