Cloud Data Test Analyst
Role details
Job location
Tech stack
Job description
- Understand and identify data requirements and incorporate business logic to develop data transformations.
- Develop and execute test plans for data integration and ETL processes in Azure Data Factory (ADF) and Databricks.
- Write and maintain SQL queries for data validation and quality checks across large datasets.
- Utilize Python to automate test scripts and handle data transformation tasks.
- Collaborate with development teams to ensure that data models, pipelines, and transformations are thoroughly tested and meet functional and performance requirements.
- Perform regression, load, and performance testing on data pipelines.
- Investigate and resolve data issues, bugs, and discrepancies in the data processing pipeline.
- Ensure the accuracy and reliability of data through continuous monitoring and reporting.
- Participate in code reviews and provide feedback to enhance the quality of the development process.
- Develop relational data models designed for usability and optimise for performance. Able to work with DBA (when required) to perform data indexing optimization.
- Assemble complex data sets across different systems that meet functional / non-functional business requirements.
- Ideally able to perform optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure data technologies.
- Able to collaborate with data analysts on topics like data quality and practices.
- Mindset of knowledge sharing, re-use, design for scale, and operational efficiency of data.
- Develop, and maintain scalable data pipelines that adhere to ETL principles and business goals.
- Analyse current business practices, processes and procedures and identify future opportunities for maximising Microsoft Azure data & analytics services.
- Work with data analyst to strive for greater functionality in our data systems.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Support the data flow to analytical tools that utilise the data pipeline to provide practical insights, enabling data driven decision making, operational efficiency and other key business performance metrics.
- Identify and problem solve data accuracy and availability challenges.
- Ensure build of data sets follow GDPR policies.
Requirements
Do you have experience in Test automation?, We are seeking a highly skilled Cloud Data Test Analyst to join our dynamic team. The successful candidate will be responsible for designing, developing, and executing comprehensive test plans to ensure the quality and performance of cloud-based data solutions. This role requires a strong understanding of software testing methodologies, automation tools, and cloud technologies such as AWS and Azure. The ideal applicant will possess excellent analytical skills, a keen eye for detail, and experience in both manual and automated testing within complex system environments. This position offers an exciting opportunity to contribute to innovative projects in a fast-paced, collaborative setting., * Expertise using Big Data technologies; and preferred experience in cloud-based data technologies and data warehousing design principles, preferably Azure
- Hands on experience with schema design and dimensional data modelling, automation processes
- Proven experience with ETL tools, Azure data factory SQL, Proven experience of building end-to-end ETL pipelines
- Passionate about continuous improvement, collaboration, and great teams
- Strong problem-solving skills coupled with good communication skills
- Ideally understanding and experience of Power BI, Tableau and fluent in SQL language
- High level fluency in Microsoft suites especially Excel
Please note that this is not an entry-level position. We are looking for candidates with prior experience in data analysis and a strong understanding of database design principles.
- If you are a highly motivated individual who enjoys working with data, analyzing trends, and providing valuable insights to drive business decisions, we would love to hear from you. Apply now!