Data Engineer

Koda Staff
4 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Tech stack

Amazon Web Services (AWS)
Confluence
Automation of Tests
Python
Performance Tuning
Power BI
SQL Databases
PySpark
Data Pipelines

Job description

  • Capability Focused QA - Implement data quality tests that reflect business rules of that capability (completeness, thresholds, referential checks) and technical tests.

  • Collaboration & Handover - Pair program with the cluster's existing Data Engineer, document every step (readme.md, Confluence), and conduct knowledge transfer sessions before roll off.

  • Performance Tuning - Optimize jobs and implement data contracts; surface schema tweaks that reduce long-term compute.

  • Issue Resolution - Quickly investigate failed loads or QA breaches and coordinate fixes with the Migration Expert and source system owners.

Requirements

· 3 + years building cloud data pipelines with solid SQL, Python/PySpark and PowerBI. Worth noting that they have an AWS cloud environment (not mandatory)

· Demonstrated experience implementing idempotent/merge based ingestion patterns.

· Familiarity with automated testing frameworks for data (Great Expectations, Soda tests).

· Strong soft skills: mentoring, documentation, willingness to "leave the campsite cleaner", collaborative mindset.

Apply for this position