{"@context":"https://schema.org","@graph":[{"@context":"https://schema.org/","@type":"JobPosting","@id":"#jobPosting","title":"Senior Data Engineer

Colibri
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Tech stack

Azure
Big Data
Cloud Computing
Cloud Engineering
Data as a Services
Information Engineering
Data Governance
Data Integration
ETL
Data Security
Data Systems
Data Warehousing
Relational Databases
Hadoop
Azure
SQL Databases
Azure
Spark
Information Technology
Non-relational Database
Data Management
Azure
Data Pipelines
Databricks

Job description

You will be responsible for building and maintaining a scalable and robust cloud-based platform that consolidates existing legacy data services. The platform will enable efficient data management, automation of processes, and provide high-quality data services to our users and tooling., * Design, develop, and implement data pipelines and ETL processes to ingest, transform, and load data into the data platform.

  • Collaborate with the Lead Architect and Cloud Engineer to ensure the seamless integration of data services within the cloud infrastructure.
  • Develop data models schemas to support efficient storage and retrieval.
  • Implement data quality and validation processes to ensure the accuracy and consistency of data.
  • Optimize data processes and queries for performance and scalability.
  • Collaborate with business stakeholders to understand their data requirements and provide insights and solutions for data-driven decision-making.
  • Work closely with data scientists to provide them with the necessary data and tooling for developing revenue-generating insights and models.
  • Implement data governance and security controls to ensure data privacy and compliance with regulations.
  • Stay updated with the latest data technologies and trends and make recommendations for technology adoption and improvements.
  • Excellent understanding of Azure data tools, especially Databricks.

Requirements

We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure., * Proven experience as a Data Engineer, working with Azure data services.

  • Strong understanding of data modelling concepts and relational and non-relational databases.
  • ficiency in SQL and experience with data integration and ETL tools (e.g., Azure Data Factory, Azure Databricks).
  • Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage).
  • Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus.
  • Knowledge of data governance and data security best practices.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills to work effectively within a team environment., * Advanced degree or equivalent professional experience in Computer Science, Data Engineering, or related field.
  • At least 5 years of experience building data pipelines and data platforms on Azure.
  • Hands-on expertise with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage.
  • Strong command of SQL and experience with relational and non-relational data stores.
  • Demonstrated ability to design scalable, high-performance data solutions.
  • Experience with data governance, privacy, and security policies.
  • Excellent analytical, problem-solving, and communication skills.

Benefits & conditions

  • Competitive salary and compensation package.

About the company

Colibri are a specialist consultancy delivering advanced data solutions and AI for a diverse client base across industries, from finance and healthcare to government and tech. As trusted partners of AWS and Databricks, we support organisations in building intelligent systems that drive measurable business outcomes.

Apply for this position