Data Engineer

Anson McCade
Edinburgh, UK
1 day ago
Apply on www.totaljobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£45,000.0 - £105,000.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Amazon Web Services Big Data Cloud Computing Information Engineering Data Systems Amazon DynamoDB Python (Programming Language) Operational Databases Scala (Programming Language) Scaled Agile Framework
+9 more
SQL Databases Unstructured Data Cloud Platform System Data Ingestion Apache Spark Build Management AWS Data Analytics Functional Programming Data Pipelines

Job description

They are looking for Data Engineers at multiple levels to join teams delivering complex, high-impact data solutions for a range of clients.

Please note: Active DV clearance is essential for these positions.

Who you’ll be working with

You’ll join a collaborative community of Data Engineers, Software Engineers, Architects, Consultants and other technical specialists, working on challenging projects where data plays a critical role in solving complex problems.

You’ll have the opportunity to work across different projects, technologies and sectors, with plenty of scope to develop your technical skills and progress your career.

What you’ll be doing

  • Design and build production-grade data pipelines and data solutions within AWS environments.
  • Work across the full data lifecycle, from ingestion and processing through to transformation, storage and consumption.
  • Build and optimise data solutions using AWS services such as Glue, EMR, Redshift, Kinesis, Lambda and DynamoDB.
  • Work with large volumes of structured and unstructured data, integrating information from multiple sources.
  • Develop data solutions using technologies including Python, Java, Scala, Spark and SQL.
  • Write scripts, develop APIs and SQL queries, and contribute to the design and deployment of scalable cloud-based data platforms.
  • Work closely with clients and cross-functional teams to understand requirements, solve technical problems and deliver high-quality outcomes.
  • Follow Agile engineering practices and contribute to technical discussions, solution design and continuous improvement.

Requirements

  • Experience designing and deploying production data pipelines within a big data environment.
  • Strong experience with AWS cloud technologies and data engineering services.
  • Hands-on experience with one or more of Python, Java, Scala, Spark and SQL.
  • Experience working with large-scale structured and unstructured datasets.
  • Understanding of data ingestion, processing, transformation and integration.
  • Strong analytical and problem-solving skills.
  • Comfortable working collaboratively with technical and non-technical stakeholders.
  • Active DV clearance - essential., If you’re an experienced Data Engineer with active DV clearance and are interested in working on complex AWS data projects, I’d be keen to hear from you.

Benefits & conditions

  • £45,000 - £105,000 depending on level and experience.
  • Multiple opportunities across different seniority levels.
  • UK-wide opportunities with hybrid working arrangements.
  • Work on technically challenging projects across Defence, Government and National Security.
  • Access to training, professional development and technical certifications.
  • Supportive technical community with opportunities for mentoring and progression.
  • Competitive benefits package including private healthcare, 25 days’ annual leave, pension, annual bonus and share ownership.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:37 min

Classifying and anonymizing data during system design

Reto Kaeser · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

1:19 min

The true role and evolution of data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all