Senior Data Engineer (Python)

Acuity INC
Bristol, United Kingdom
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Bristol, United Kingdom

Tech stack

Business Logic
Automation of Tests
Azure
Software Quality
Code Review
Data Transformation
IT Management
Python
Machine Learning
Power BI
SQL Databases
Data Ingestion
Pandas
Pytest
PySpark
Data Pipelines
Databricks

Job description

As a Data Engineer (Python), you will play a key role in building, testing, and operating scalable data products and machine learning solutions. You'll work closely with data scientists, engineers, and business stakeholders to design robust data pipelines, ensure high data quality, and support production-ready deployments. In this role, you'll contribute across the full data lifecycle - from ingestion and transformation to deployment, testing, and operational support. You'll also help strengthen our IT governance processes through code reviews and collaboration, while continuously improving automation and reliability within our data platform.

Requirements

Do you have experience in SQL?, * Strong experience with Python, including PySpark and pandas

  • Solid knowledge of SQL for data transformation, validation, and testing
  • Hands-on experience with Azure DevOps, especially CI/CD pipelines
  • Experience implementing automated tests (e.g. pytest, SQL-based tests) for data products and machine learning models
  • Ability to design and implement data ingestion pipelines (initially as a Proof of Concept)
  • Strong understanding of data quality principles, with the ability and willingness to dive into business logic
  • Experience supporting operational activities in a production environment
  • Comfortable reviewing pull requests and contributing to IT governance and code quality standards

Nice to Have

  • Experience with Databricks, ideally including Databricks Asset Bundles
  • Exposure to Power BI, with potential to support deployment of dashboards in the future
  • Familiarity with deploying and operating machine learning models in a data platform

Apply for this position