Data Engineer

ECM Selection Limited
Cambridge, UK
1 day ago
Apply on www.ecmselection.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£80,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Batch Processing Big Data Information Engineering Query Languages Elasticsearch Monitoring of Systems Python (Programming Language) Machine Learning NumPy Scala (Programming Language)
+10 more
Software Engineering SQL Databases Datadog Apache Spark Pandas Pyspark Kubernetes Docker Databricks Programming Languages

Requirements

  • An appreciation for data engineering or software development.
  • A strong conceptual and analytical mindset, with the ability to think in an abstract context and articulate, explain and sell ideas and approaches to other stakeholders.
  • Fluency in Python and familiarity with other programming languages.
  • Skills with SQL and probably other query languages.
  • Some exposure to PySpark and/or other common Python packages such as Pandas or NumPy.
  • An understanding of batch processing pipelines and testing / monitoring systems.
  • Bachelors, masters or PhD qualifications in a relevant technological or engineering field.

Other skills and interests are beneficial but not essential, including in machine learning and AI, leadership and mentoring, Scala, Spark, Elasticsearch, Datadog, Databricks, AWS, Docker / Kubernetes.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.ecmselection.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Maximizing execution memory effectively via python numpy broadcasting

Jodie Burchell · LIVE

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:25 min

Replacing NumPy with cuPy for straightforward GPU acceleration

Paul Graham Paul Graham · World Congress 2025

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

Videos

See all

Related articles

See all