Platform Engineer

We are looking for an experienced Platform Engineer to support, maintain and further develop our Cloudera, Elastic Stack and Dataiku platform environment.

The role combines platform operations, solution development, automation and user support. You will work closely with data engineers, data scientists, analysts and business stakeholders to deliver stable, scalable and efficient data and analytics solutions., * Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms

• Design and develop data pipelines, workflows, dashboards and platform integrations
• Build and support real-time streaming solutions using Apache Kafka
• Develop custom scripts, plugins and integrations using Python, Scala and REST APIs
• Design and automate ETL and data ingestion processes using tools such as Apache NiFi and Logstash
• Create Kibana dashboards, reports, queries and search solutions
• Support the deployment and operationalisation of machine learning models in Dataiku
• Automate platform deployments and operations using Ansible, Terraform or similar tools
• Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies
• Troubleshoot platform, workflow and integration issues
• Create reusable scripts, templates, libraries and technical documentation
• Provide guidance, training and platform support to users and internal teams
• Support occasional weekend or public holiday activities related to system changes or testing

• Strong experience with at least two of the following platforms:

• Cloudera
• Elastic Stack
• Dataiku DSS

Good knowledge of Hadoop ecosystem technologies such as HDFS, YARN, Hive, Spark and KafkaExperience with Elasticsearch, Logstash, Kibana and BeatsExperience designing data pipelines, ETL processes and streaming solutionsProgramming or scripting experience with Python and/or ScalaExperience integrating platforms and external systems through REST APIsGood knowledge of GitHub, branching strategies, pull requests and code reviewsExperience with CI/CD, infrastructure automation and deployment processesUnderstanding of clean code, secure coding and documentation standardsStrong troubleshooting, analytical and communication skillsAbility to translate business requirements into practical technical solutionsProfessional English skills Preferred Qualifications

• Experience with machine learning deployment and data science platforms
• Knowledge of Apache NiFi, Terraform, Ansible or Puppet
• Experience working in enterprise-scale data and analytics environments
• Familiarity with agile and DevOps working practices, * Stable and well-maintained platform environments
• Reliable delivery of data pipelines, dashboards and analytics solutions
• Automated and optimised platform operations
• Effective user support and knowledge transfer
• Clear, reusable and up-to-date technical documentation