Senior Data Engineer

Featuredneweasy
Manchester, UK
1 day ago
Apply on www.reed.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£75,000.0 - £85,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Cloud Computing Continuous Integration Data Architecture Information Engineering Data Infrastructure Extract Transform Load (ETL) Apache Hive Python (Programming Language) Sql Optimization Data Lakes
+4 more
Pyspark Software Version Control Data Pipelines Databricks

Job description

  • Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
  • Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
  • Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
  • Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions.
  • Embed data quality, governance and access controls throughout the data lifecycle.
  • Mentor a junior engineer and help mature a growing data function.

Requirements

  • “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc)
  • Advanced SQL and Python coding skills.
  • A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions.
  • Solid grounding in data architecture, modelling and modern data platform design.
  • Cloud experience, preferably AWS, and familiarity with CI/CD and source control best practice.
  • Desirable: More Data Science leaning background or want to explore ML / AI & data / predictive modelling strategies.

Benefits & conditions

  • A highly visible, hands-on role with real influence over data architecture and platform strategy.
  • Join a small, high-impact team at the heart of the company’s data strategy, with genuine scope to shape how it evolves. We are near the beginning of our Data Ops’ journey - so an excellent opportunity to shape the future!
  • Extensive benefits package including health insurance, income protection, life assurance, subsidised gym membership and 25 days’ holiday plus your birthday off.

About the company

UK HQ based & fast-growing software business (400+ staff, globally), serving hundreds of enterprise customers worldwide, are looking for a Senior Data Engineer to help shape the future of its data platform. You’ll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.reed.co.uk
Prepare application