Data Engineer - London - Permanent
Role details
Job location
Tech stack
Job description
Data Engineer - London - Permanent
Location: London (Onsite - 5 Days/Week) Role: Data Engineer Experience: 4-6 Years Job type: Permanent
About the Role
We are seeking a skilled Data Engineer with strong hands-on experience in designing and building scalable data solutions. The role involves working on Real Time and batch data pipelines, supporting data warehouse development, delivering insights through Power BI, and contributing to AI-driven initiatives using OpenAI APIs.
The ideal candidate will have solid exposure to modern data engineering practices, cloud platforms (Azure), and a passion for building intelligent, data-driven solutions.
Key Responsibilities
- Design and develop Real Time and ETL/ELT data pipelines integrating multiple data sources (APIs, databases, flat files).
- Support the development and maintenance of a scalable data warehouse for reporting and analytics.
- Build and enhance Power BI dashboards and reports for business stakeholders.
- Develop data integration workflows using Azure Data Factory, Logic Apps, and Azure Functions.
- Perform data processing and transformation using Python and SQL.
- Contribute to AI-driven solutions using OpenAI APIs for automation, NLP, and insights.
- Assist in building AI agents for post-sales call audits and analysis.
- Collaborate with cross-functional teams including analysts, product managers, and data scientists.
- Monitor pipeline performance and ensure data quality, consistency, and reliability.
- Follow best practices for data governance, security, and compliance.
Required Qualifications
-
4-5 years of experience in Data Engineering or similar roles.
-
Hands-on experience in building ETL/ELT data pipelines.
-
Strong proficiency in Python for data manipulation and automation.
-
Solid SQL skills for querying and managing data.
-
Experience with Azure ecosystem:
-
Azure Data Factory
-
Azure Logic Apps/Azure Functions
-
Azure Synapse/Data Lake (preferred exposure)
Experience in Power BI for reporting and dashboards.
Basic exposure to OpenAI APIs/AI/ML concepts.
Good understanding of data warehousing concepts.
Strong analytical and problem-solving skills.
Preferred Qualifications
- Exposure to DevOps/CI-CD pipelines.
- Familiarity with Databricks/Microsoft Fabric.
- Understanding of data privacy regulations (GDPR) and secure data handling practices.
If interested to hear more about this role, please send your CV to (see below) with the best contact details to get connected for a quick discussion on the same.
Regards,
Mary Priscilina
Requirements
-
4-5 years of experience in Data Engineering or similar roles.
-
Hands-on experience in building ETL/ELT data pipelines.
-
Strong proficiency in Python for data manipulation and automation.
-
Solid SQL skills for querying and managing data.
-
Experience with Azure ecosystem:
-
Azure Data Factory
-
Azure Logic Apps/Azure Functions
-
Azure Synapse/Data Lake (preferred exposure)
Experience in Power BI for reporting and dashboards.
Basic exposure to OpenAI APIs/AI/ML concepts.
Good understanding of data warehousing concepts.
Strong analytical and problem-solving skills.
Preferred Qualifications
- Exposure to DevOps/CI-CD pipelines.
- Familiarity with Databricks/Microsoft Fabric.
- Understanding of data privacy regulations (GDPR) and secure data handling practices.