Data Platform Engineer

As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms.

You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams.

A strong command of Apache NiFi is essential for this role.

You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery.

You should be adept at identifying and resolving issues within NiFi flows, managing performance bottlenecks, and implementing robust error handling strategies.

You'll work closely with cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms.

Role Responsiblities:

Not limited to

• Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies.
• Troubleshoot and optimize NiFi flows, including performance tuning, error resolution, and flow control.
• Integrate NiFi with cloud platforms, databases (SQL & NoSQL), APIs, and third-party systems.
• Ensure compliance with regulatory and security requirements across data storage, transfer, and access layers.
• Support data migration efforts and implement disaster recovery protocols.
• Continuously monitor data infrastructure performance and recommend improvements.
• Collaborate with cross-functional teams to align data platform capabilities with business needs and compliance requirements.
• Maintain documentation of data flows and processes, ensuring knowledge sharing and operational transparency.

• Over 3 years of relevant experience in data engineering, platform engineering, or a related field.

• Proficiency in Java and SQL.

• Deep understanding of core NiFi concepts: FlowFiles, Processors, Controller Services, Schedulers, Web UI.

• Knowledge of data modeling, replication, and query optimization.

• Experience designing and optimizing data flows for batch, real-time streaming, and event-driven architectures.

Security Requirements: SC & UK EYES ONLY

Data Platform Engineer- 12 month contract - Warton Aerodrome (Remote) - 74.26 ph UMB or 55 ph PAYE (Inside IR35)

The Umbrella rate quoted above is the Gross Umbrella rate (i.e. the rate we pay to the Umbrella Company inclusive of ALL employment costs). Please note, the rate paid by the Umbrella will be less, as will a Limited Deemed rate or Agency PAYE rate. Please get in touch to discuss the rates via these different payment vehicles.