Databricks Engineer - SC Cleared

iO Associates
Liverpool, United Kingdom
19 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 143K

Job location

Remote
Liverpool, United Kingdom

Tech stack

Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Business Analytics Applications
Azure
Cloud Computing
ETL
Data Systems
DevOps
Python
SQL Databases
Data Processing
Spark
Data Lake
PySpark
Machine Learning Operations
Data Pipelines
Databricks

Requirements

Are you an SC Cleared Databricks Engineer with a passion for building scalable data solutions? Do you have extensive experience in designing and optimising data pipelines, cloud-native platforms, and advanced analytics ecosystems? We are working with a leading multinational client seeking a skilled Databricks Engineer to drive innovation and enable data-driven decision-making, advanced analytics, and AI capabilities.

The successful client will be responsible for designing, developing, and optimising data pipelines and analytics solutions using Databricks within a secure environment

Critical Skills

  • Extensive experience with Databricks (Spark, Delta Lake, and MLflow).
  • Proficiency in ETL/ELT development and orchestration tools (DBT, Airflow, or similar).
  • Hands-on experience with cloud platforms (AWS, Azure, or GCP).
  • Solid understanding of SQL, Python, and PySpark for data processing.
  • Familiarity with CI/CD pipelines and DevOps practices for data solutions.

You will be collaborating with a variety of data specialists. The role will require you to maintain a passion for solving complex data sets, spearheading innovation whilst ensuring efficient delivery of data solutions.

Apply for this position