Remote Senior Data Engineer

Adria Solutions ltd
Warrington, UK
2 months ago
Apply on find.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Big Data Cloud Computing Cloud Database Data Infrastructure Github Python (Programming Language) Machine Learning Cloud Services SQL Databases
+5 more
Data Streaming Systems Integration Pyspark Data Analytics Machine Learning Operations

Job description

An exciting opportunity has arisen for a Senior Data Engineer to join my client’s dynamic and growing data team. In this role, you will work across the full data lifecycle-streaming, enrichment, and curation-within a cloud-based environment. You will be responsible for ensuring data quality, integrating key data sets, and supporting the insights and data science teams.

As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access to advanced training in ML Ops. Additionally, you will play a key role in mentoring and developing junior data engineers., * Automate and maintain data pipelines within a cloud-based environment (AWS/GCP/Azure).

  • Source and verify data from multiple sources, ensuring it is ready for ingestion.
  • Gain experience in data infrastructure and contribute to the development of new cloud-based methodologies.
  • Analyse large datasets using Python and SQL.
  • Set up new pipelines for data streaming, enrichment, and curation.
  • Manage and maintain source code repositories (GitHub).
  • Investigate and apply AI/ML solutions to enhance cloud capabilities., * Work with cutting-edge technologies in cloud data engineering and AI/ML.
  • Opportunity for career growth and professional development.
  • Be part of an innovative and forward-thinking data team.

Requirements

  • Strong proficiency in SQL and Python.
  • Experience in cloud data solutions (AWS, GCP, or Azure).
  • Experience in AI/ML.
  • Experience with PySpark or equivalent.
  • Strong problem-solving and analytical skills.
  • Excellent attention to detail.
  • Ability to manage stakeholder relationships effectively.
  • Strong communication skills and a collaborative approach., If you are a motivated Senior Data Engineer with a passion for cloud technologies, AI, and data analytics, we’d love to hear from you.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on find.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all