Data Engineer

Reyan Technologies Ltd is looking for a skilled Data Engineer to join our team and support the design, development, and maintenance of data solutions that enable business insights. As a Data Engineer, you will be responsible for developing and maintaining ETL/ELT processes, cleansing and validating data, optimizing SQL queries, and building reliable data pipelines. You will work closely with developers, analysts, and business stakeholders to deliver scalable and high-quality data solutions while contributing new ideas to improve existing processes.

Job Role and Responsibilities:

· Build, maintain, and support data pipelines using Azure Data Factory and Snowflake.

· Develop and maintain ETL/ELT processes for integrating data from multiple source systems.

· Design and maintain data warehouse structures using star and snowflake schemas.

· Write, review, and optimise SQL queries, stored procedures, views, and functions.

· Perform data cleansing, validation, reconciliation, and quality checks to ensure accurate reporting.

· Support data migration, transformation, and integration activities across cloud and on-premises environments.

· Develop and maintain Azure Data Factory pipelines for data ingestion and transformation.

· Work with Azure Data Lake Storage, Azure SQL Database, and Azure Databricks to support data processing requirements.

· Assist in developing Spark-based data processing solutions where required.

· Collaborate with Business Analysts, Developers, and QA teams to understand business requirements and deliver data solutions.

· Support reporting and analytics teams by preparing reliable datasets for Power BI and other reporting tools.

· Monitor ETL jobs, troubleshoot failures, and optimise pipeline performance.

· Participate in Agile/Scrum ceremonies including sprint planning, stand-ups, reviews, and retrospectives.

· Contribute ideas for improving data engineering processes and automation.

· Master's degree in computer science (mandatory).

· 8+ years of experience in Data Engineering, Data Analysis, BI Development, or a similar data-focused role.

· Experience working with Snowflake or other cloud-based data warehouse platforms.

· Strong expertise in SQL development, query optimisation, and data modelling.

· Experience designing, developing, and maintaining ETL/ELT pipelines.

· Hands-on experience with Microsoft Azure data services, including Azure Data Factory, Azure SQL Database, Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics.

· Working knowledge of Apache Spark and distributed data processing.

· Strong proficiency in Python, SQL, and data transformation techniques.

· Good understanding of data warehousing concepts, including Star Schema and Snowflake Schema.

· Experience with cloud storage solutions and reporting tools such as Power BI.

· Knowledge of data validation, data quality, reconciliation, and performance optimisation techniques.

· Experience working with ETL tools such as SSIS and cloud-based data integration platforms.

· Experience with version control tools such as Git or SVN.

· Good stakeholder communication and collaboration skills with the ability to work effectively across technical and business teams.

· Experience working in Agile/Scrum development environments.

Desirable Skills:

· Exposure to Snowflake or other cloud data warehouse technologies.

· Knowledge of Azure AI or data analytics services.

· Experience developing interactive dashboards using Power BI.

· Familiarity with data migration and cloud transformation projects.

· Understanding of database performance tuning and query optimisation.

· Experience working with large and complex datasets.

· Ability to troubleshoot and resolve data-related issues efficiently.

· Willingness to learn and adopt new cloud technologies and data engineering tools.

· Strong attention to detail and commitment to data quality., * Master's (required), * Data Engineering, Data Analysis, BI Development.: 8 years (required)

Pulled from the full job description

• Free parking
• On-site parking