{"@context":"https://schema.org","@graph":[{"@context":"https://schema.org/","@type":"JobPosting","@id":"#jobPosting","title":"Senior Data Engineer
Role details
Job location
Tech stack
Job description
You will be responsible for building and maintaining a scalable and robust cloud-based platform that consolidates existing legacy data services. The platform will enable efficient data management, automation of processes, and provide high-quality data services to our users and tooling., * Design, develop, and implement data pipelines and ETL processes to ingest, transform, and load data into the data platform.
- Collaborate with the Lead Architect and Cloud Engineer to ensure the seamless integration of data services within the cloud infrastructure.
- Develop data models schemas to support efficient storage and retrieval.
- Implement data quality and validation processes to ensure the accuracy and consistency of data.
- Optimize data processes and queries for performance and scalability.
- Collaborate with business stakeholders to understand their data requirements and provide insights and solutions for data-driven decision-making.
- Work closely with data scientists to provide them with the necessary data and tooling for developing revenue-generating insights and models.
- Implement data governance and security controls to ensure data privacy and compliance with regulations.
- Stay updated with the latest data technologies and trends and make recommendations for technology adoption and improvements.
- Excellent understanding of Azure data tools, especially Databricks.
Requirements
We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure., * Proven experience as a Data Engineer, working with Azure data services.
- Strong understanding of data modelling concepts and relational and non-relational databases.
- ficiency in SQL and experience with data integration and ETL tools (e.g., Azure Data Factory, Azure Databricks).
- Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage).
- Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus.
- Knowledge of data governance and data security best practices.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills to work effectively within a team environment., * Advanced degree or equivalent professional experience in Computer Science, Data Engineering, or related field.
- At least 5 years of experience building data pipelines and data platforms on Azure.
- Hands-on expertise with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage.
- Strong command of SQL and experience with relational and non-relational data stores.
- Demonstrated ability to design scalable, high-performance data solutions.
- Experience with data governance, privacy, and security policies.
- Excellent analytical, problem-solving, and communication skills.
Benefits & conditions
- Competitive salary and compensation package.