Senior Data Engineer - Databricks

You’ll build and improve data pipelines that solve real business problems, working with modern Databricks and cloud technologies. Alongside hands-on development, you’ll troubleshoot issues, improve performance and work closely with engineers, analysts, data scientists and technical leads., You will:

• Build scalable pipelines using Databricks, Spark and PySpark.
• Develop ETL/ELT and data transformation workflows using Python and SQL.
• Create and maintain Databricks notebooks, jobs, workflows and clusters.
• Work with Delta Lake and lakehouse architectures.
• Monitor, troubleshoot and optimise pipeline performance.
• Maintain high standards of data quality and reliability.
• Work across AWS, Azure or GCP environments.
• Automate processes and create reusable engineering solutions.
• Support and mentor junior Data Engineers.

Are you an experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands-on experience with Databricks, PySpark, Python and SQL?, * 5+ years’ Data Engineering experience.

• Strong hands-on Databricks, PySpark, Python and SQL skills.
• Experience building and optimising ETL/ELT data pipelines.
• Knowledge of Delta Lake and data warehousing.
• Experience with at least one of AWS, Azure or GCP.
• Strong troubleshooting and problem-solving skills.
• A Computer Science or related technical background.
• Experience with Unity Catalog, MLflow, CI/CD, Terraform or Databricks certification would be a bonus.

7Dxperts helps organisations solve complex challenges using Data, Spatial and Machine Learning technologies. We focus on building practical, targeted solutions that make a measurable difference.

What we offer

• Databricks training and upskilling.
• Support towards technical certifications.
• Exposure to AWS, Azure and GCP.
• Varied data engineering projects.
• Technical and leadership development.
• Sponsorship may be available depending on circumstances.