WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer

Proactive.IT Appointments Ltd.
Exeter, United Kingdom
2 days ago
Apply on www.reed.co.uk
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
£104,000 - £117,000
Working hours
Regular working hours
Job source
www.reed.co.uk

Tech stack

Amazon Web Services Microsoft Azure Customer Data Management Extract Transform Load (ETL) Data Warehousing Apache Hive Python (Programming Language) Cloud Services Standard Sql SQL Databases Transact-SQL Cloud Platform System
+6 more
Git Pandas Microsoft Fabric Pyspark Software Version Control Data Pipelines

Job description

Our client is looking for an experienced Data Engineer with strong Microsoft Fabric, PySpark and Splink experience. You’ll be responsible for developing data matching pipelines, cleansing and standardising customer data, tuning matching models and building accurate master customer records across multiple systems.

Requirements

  • Experience building and supporting data pipelines in a cloud data platform, ideally Microsoft Fabric.
  • Strong Python, including pandas and PySpark.
  • Strong SQL, including Spark SQL or T-SQL.
  • Experience cleaning and standardising data
  • Experience matching, deduplicating or reconciling records across systems, whether rule-based or probabilistic.
  • Understanding of how to measure data quality and match accuracy, including false positives and missed matches.
  • Good working knowledge of UK GDPR and handling personal data securely.
  • Use of version control (Git) and writing readable, documented, tested code.
  • Ability to explain technical decisions and trade-offs clearly to non-technical colleagues., * Amazon Web Services (AWS)
  • Cloud Services & Infrastructure
  • Communication Skills
  • Data Pipeline Development
  • Data Warehousing
  • ETL
  • Microsoft Azure
  • Python Programming
  • SQL Databases
  • Stakeholder Management

Benefits & conditions

Contract £400-£450 per day 6 Weeks Inital Contract Length Remote (Inital 2-3 days on-site to kick start the project)

About the company

Proactive Appointments Limited operates as an employment agency and employment business and is an equal opportunities organisation

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.reed.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…