Data Engineer

• Design, develop, and maintain scalable data pipelines using Python and orchestration tools such as Dagster.
• Create and optimise efficient data models to support both transactional and analytical workloads.
• Develop high-performance SQL queries, procedures, and integrations for APIs and data services.
• Debug, enhance, and maintain existing systems and codebases.
• Build and execute unit and integration tests to ensure reliability and maintainability.
• Conduct profiling and performance optimisation to improve scalability and responsiveness.
• Produce clear technical documentation for pipelines, databases, and architecture.
• Collaborate with cross-functional engineering teams across backend, cloud, and product development.
• Contribute to architectural decisions and continuously evaluate new technologies and best practices.

• Degree in Computer Science, Engineering, or equivalent practical experience.
• Strong experience with relational databases and SQL (PostgreSQL preferred).
• Excellent Python programming and object-oriented development skills.
• Experience designing data models for both operational and analytical systems.
• Strong debugging, troubleshooting, and performance tuning capabilities.
• Experience using Git and participating in collaborative code reviews.
• Strong communication and teamwork skills.
• Passion for building scalable in-house technology solutions using both custom and off-the-shelf tools.

Nice to Have

• Experience with Dagster or similar orchestration platforms.
• Familiarity with CI/CD pipelines and tools such as GitHub Actions.
• Knowledge of REST and/or GraphQL APIs.
• Experience working in Linux environments.
• Familiarity with Docker and Kubernetes.
• Understanding of Test-Driven Development (TDD), PyTest, and software design patterns.

Skills

• Data Engineering & Analysis
• Data Engineering Roles
• ETL & Data Warehousing
• ETL (Extract Transform Load)
• Python
• SQL