Data Pipeline Developer

data platform (data pipelines, data integrations, data preparation, data models, analytical and reporting marts) based on business requirements using agreed design patterns. - Determine the most appropriate tools, methods, and design patterns to meet business requirements. - Proactively identify and suggest improvements. - Prepare data for exposure through APIs. - Document, support, manage, and maintain the modern data platform built within your squad. - Provide guidance and training to downstream data consumers on best practices. - Support and build new data APIs. - Promote the effective use and value of data across the organisation. - Comply with all company policies. - Perform any other duties assigned by management. Requirements & Skills - Experience with Data Warehousing and Data Modelling. - Experience with Data Lakes (AWS Lake Formation, Azure Data Lake). - Experience with Cloud Data Warehouses (AWS Redshift, Azure Synapse, Snowflake). - Experience with ETL/ELT/Pipeline

tools (AWS Glue, Azure Data Factory, Fivetran, Stitch). - Knowledge of messaging systems (AWS SNS & SQS, Azure ASQ, Kafka, RabbitMQ). - Programming skills in SQL, Python, Scala, or Java. - Experience with cloud workflow services (AWS Step Functions, Azure Logic Apps, Camunda). - Experience with event and schedule management (AWS Lambda, Azure Functions). - Knowledge of the Microsoft BI Stack (SQL Server, SSIS, SSAS, SSRS). - Experience with reporting and visualisation tools such as Power BI, QuickSight, or Mode. - Knowledge of NoSQL and Graph Databases (AWS Neptune, Azure Cosmos DB, Neo4j) - desirable. - API Management experience - desirable. - Excellent communication and interpersonal skills. - Strong critical thinking, analytical, and problem-solving skills. - Ability to prioritise and manage workload independently. - Ability to work both independently and collaboratively within a team. - Working knowledge of Agile Software Development Lifecycles.