Databricks Architect

Infected Blood Compensation Authority
Norwich, United Kingdom
3 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 150K

Job location

Remote
Norwich, United Kingdom

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Data analysis
Data Architecture
Information Engineering
ETL
Data Security
Data Systems
Python
SQL Databases
Data Processing
Large Language Models
Pandas
PySpark
Scikit Learn
Data Management
Databricks

Job description

  • Architect and implement data solutions using Databricks on AWS, PySpark, and Python
  • Lead cloud migration initiatives, including on-prem to AWS migrations
  • Drive GenAI-enabled automation for data asset migration
  • Develop scalable data models and deliver actionable business insights
  • Design and optimize ETL pipelines (Informatica or similar tools)
  • Build and deploy PySpark applications for large-scale data processing
  • Work on LLM pretraining, fine-tuning, augmentation, and optimization
  • Ensure high data quality through cleaning, transformation, and validation (Python/SQL)
  • Automate data workflows to enhance scalability and efficiency
  • Maintain clear technical documentation and best practices, A government agency in the UK seeks a Principal Data & Systems Architect to design and deliver a secure data platform. Responsibilities include leading the architecture strategy, ensuring data quality, and guiding teams in data management. The ideal candidate will have..., SAP Data Analytics Director (BW/Datasphere/BDC). Location: United Kingdom. 100% Remote Working. Flexible Start Date from April 2026 +/- Onwards. Permanent Job. Fixed Basic Salary between £120k - £150k/annum + 20% Bonus. Our client, headquartered in the United Kingdom, is a..., The Account CTO partners closely with the client organization to translate business and technology challenges into scalable solution architectures. The role is responsible for understanding the client's application landscape, technology standards, and domain requirements,..., We seek an experienced Associate Director, Gen AI Architect, specialising in the Energy, Resources & Industrials (ER&I) sector, to join our AI & Data team. This role is pivotal in driving the adoption and implementation of Gen AI solutions within ER&I.Generative AI is..., Our passionate and experienced people deliver successful clean energy projects globally.Driving a clean energy future through state-of-the-art renewable technologies.Browse our latest resources, including company updates, customer stories, industry insights, and research..., As a Principal Architect at JPMorgan Chase within the Enterprise Technology, AI/ML & Data Platforms organisation youprovide expertise to enhance and develop architecture platforms based on modern cloud-based technologies, as well as support the adoption of strategic global...

Requirements

We are seeking a Senior Databricks Architect with 15+ years of experience in Data Engineering/Analytics to design and deliver scalable, secure, and cost-efficient data solutions on AWS. This is a leadership role requiring strong hands-on expertise, proactive risk management, and excellent stakeholder communication skills., * 15+ years in Data Analyst/Data Engineer/Data Architect roles

  • Strong expertise in Databricks on AWS
  • Advanced Python (Pandas, Scikit-learn) and SQL skills
  • Proven experience in large-scale cloud data migrations
  • Hands-on experience with LLMs and GenAI-based automation
  • Strong experience designing secure, high-performance data architectures

Key Competencies

  • Proactive risk & issue management
  • Strong requirement clarification and stakeholder engagement skills
  • Excellent communication - able to translate technical insights into business value
  • Critical thinker with strong problem-solving capabilities
  • Self-driven, autonomous, and collaborative approach

Benefits & conditions

Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data-guided through modern Data & AI...

About the company

A leading renewable energy company in Glasgow is seeking a Senior Data Engineer to lead the development of scalable data solutions. This role requires advanced expertise in Databricks and involves designing complex data pipelines, mentoring junior engineers, and shaping the..., Palantir Solution Architect Our client is a Leading Digital Transformation Consultancy named a Times Top 100 Company To Work For for seven consecutive years. As a Palantir Solution Architect, you will lead multi-skilled agile teams to design and deliver contemporary data..., OverviewWe are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive..., Palantir Data Engineer Our client is a Leading Digital Transformation Consultancy who have been named a Times Top 100 Company To Work For for 7 consecutive years. As a Palantir Data Engineer, you will join a highly regarded digital, data, and technology consultancy...

Apply for this position