Senior Data Engineer

OKTO is seeking a Senior Data Engineer to lead the architecture and implementation of a mission-critical digital operations system for several major projects. This role is foundational to our mission - connecting diverse system endpoints such as power ,airflow, heating, medical gas and fire alarms into a centralised, resilient cloud-based infrastructure.

You will be responsible for designing the end-to-end data lifecycle from high frequency time series ingestion to the creation of a "Master Dashboard" that ensures critical systems remain vital, accurate and trustworthy.

OKTO provides industry leading investment per employee in personal development and on-going training.

We are committed to employing the best qualified and highest certified technical team in the UK., * Data architecture & modelling: Design and implement a scalable architecture on Microsoft Azure to organise raw system data into curated, reporting-ready layers.

• Operational system integration: Build robust pipelines to ingest and process high-frequency time-series and IoT-like data from critical infrastructure.
• Cloud database production: Develop and manage the foundational cloud database using Azure Databricks, Synapse and Data Lake to serve as the single source of truth.
• Real-time processing: Implement and optimise streaming workloads using Kafka, Event Hub and Spark Streaming to ensure low-latency data availability for life-critical monitoring.
• Governance & compliance: Enforce strict data quality frameworks and maintain PII/PHI compliance, ensuring the integrity of sensitive healthcare and operational data.
• Visualisation & reporting: Collaborate with stakeholders to design and deploy the "Master Dashboard" using Power BI, utilising DAX and semantic models for actionable insights., * Chance to be part of a focused and goal driven team
• Work alongside next generation building and estate controls and design technology and software
• An environment that helps foster personal and professional development offering in-house and industry training
• A hardworking and personally accountable working environment
• Excellent career progression opportunities

The technical training includes:

• BCIA bms training
• AVIXA AV training
• Cnet IT training
• Nexus labs Smart Building training
• CEDIA training Smart Home Training

Extensive Manufacturer / service provider training including:

• Schneider
• Tridium
• Barco
• Crestron
• Aruba
• Cisco
• Power BI
• Azure

Do you have experience in Unity?, * Azure mastery: Deep expertise in the Azure Ecosystem, specifically Databricks, Azure Data Factory (ADF), Synapse and Unity Catalog.

• Data engineering: Proficiency in Python, PySpark and Spark SQL for ETL/ELT pipeline development.
• Time-series expertise: Proven experience handling real-time, high frequency data feeds (e.g. aviation, sensor or industrial data)
• Schema design: Advanced knowledge of Star and Snowflake Schemas and Lakehouse architectures.
• Quality assurance: Hands-on experience with data validation tools like Great Expectations and observability platforms like Grafana.
• DevOps: Familiarity with CI/CD processes using Azure DevOps or GitHub Actions.

Preferred Qualifications:

• 6+ years of experience in data engineering with a focus on resilient, high availability systems.
• Strong understanding of security protocols, including RBAC and Row-level Masking.
• Ability to work closely with AI/ML teams to support predictive maintenance or digital data products.

The successful permanent applicant will enjoy £4,000.00 per annum investment in their own personal development every year.

The successful permanent candidate will also receive a number of employment benefits such as:

• Company pension
• Cycle to work scheme
• Paid volunteer time
• Private medical insurance
• Birthday holiday
• Free lunch Fridays
• Length of service benefit
• Cinema tickets
• Free annual eye test