Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+10 more
Job description
I’m recruiting a hands-on Data Engineer to build Azure data platforms and integrations for clients globally. You’ll turn messy data from APIs, Excel files and PDFs into reliable datasets that power dashboards, client portals and data-sharing products.
What you’ll do Build Python and PySpark ingestion pipelines with record-level lineage, automated tests and reconciliation checks. Model data in a Databricks medallion lakehouse and design loads that can be safely rerun. Deploy and extend Azure environments in client tenancies using Terraform and CI/CD. Serve data to dashboards and portals backed by Azure SQL, and work directly with clients to define requirements and metrics.
Requirements
Strong Python and SQL, with hands-on experience using pandas, PySpark and pytest. Production Azure Databricks experience with Delta Lake, Unity Catalog and Workflows. Experience with Azure Storage, Key Vault, managed identities and private networking. Practical experience with Terraform, Git and CI/CD using Azure DevOps or GitHub Actions, plus REST API ingestion and relational data modelling.
Experience in energy would be a bonus. Applications from other sectors are welcome.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…