Data Engineer

The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and architectures.

The ideal candidate will possess a strong background in developing and maintaining shared component and framework libraries while collaborating closely with Technology, Product, and Business stakeholders to ensure the availability, quality, and reliability of data., * Design, develop, and optimise robust data pipelines and ETL processes.

• Engage in hands-on development with Scala, Java, or Python through system integration projects or as a data scientist.
• Utilise technologies such as Spark, Elastic, Restful APIs, JSON, and Tomcat.
• Build reusable libraries and shared capabilities to expedite time to market for Data Engineering delivery teams.
• Continuously improve platform capabilities and maintain overall platform health to address evolving needs.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
• Ensure data quality, integrity, and security across all data systems.
• Monitor, troubleshoot, and enhance data workflows and performance.
• Provide automation capabilities to assist delivery teams with data validation, testing, and deployments.
• Stay abreast of emerging data engineering technologies and trends.
• Gain experience with Azure cloud services, including Azure Data Factory, Gen 2, and Azure Databricks.
• Work with Elasticsearch and maintain advanced SQL knowledge, preferably on MS SQL Server and Azure cloud databases.
• Navigate the DevOps lifecycle using tools such as Git, ADO, and Jenkins.
• Utilise Jira/Confluence and apply Agile methodologies in projects.
• Maintain high customer satisfaction through the timely delivery of high-quality solutions and effective problem resolution.
• Communicate proactively and effectively with business users, support teams, vendors, and stakeholders.
• Utilise strong analytical skills for diagnosing and troubleshooting potential system issues, demonstrating a quick turnaround in solutions.

• Knowledge of and or exposure to Quantexa would be preferential
• Highly proficient in Scala, Python, and SQL.
• Well-versed in software engineering and systems design principles.
• Hands-on experience with Azure cloud data platforms is essential.
• Familiarity with Spark and Apache Airflow is required.
• Proficient in Linux/Unix/*nix environments.
• Strong knowledge of ETL tools and data modelling techniques.

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone’s chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive.

As part of our standard hiring process to manage risk, please note background screening checks will be conducted on all hires before commencing employment.

We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.