Data Engineer

You will deliver Hands on development on Nexus Platform Monitoring daily BAU data pipelines and ensure our data solution is refreshed up to date every day Enhance the daily BAU process. Making it easier to monitor and less likely to fail and hands on development on Data Lake build, change and defect fix Building new data pipelines using existing frameworks and patterns Working with the team within an Agile framework using agile methodology tooling that controls our development and CI/CD release processes Contributing to the new Data Lake technology across the organisation to address a broad set of use cases across data science and data warehousing Skills and Experience Essential Experience with data solution BAU processes (ETL, table refresh etc.) Experience with integration of data from multiple data sources Experience in Big Data data integration technologies such as Spark, Scala, Kafka Experience in programming language such as Python or Scala. Experience using AWS, DBT and Snowflake.

Analytical and problem-solving skills, applied to data solution Experience of CI/CD Good aptitude in multi-threading and concurrency concepts Familiarity with the fundamentals of Linux scripting language Desirable Experience of ETL technologies AWS exposure (Athena, Glue, EMR, Step functions) Experience of Snowflake and DBT Experience with data solution BAU processes (ETL, table refresh etc Previous proficiency with ETL technologies (e.g. Talend, Informatica, Abinitio) Previous exposure to Python Previous exposure to own data solution BAU monitoring and enhancement Exposure to building applications for a cloud environment #LI-Hybrid #LI-TM1 At NewDay, we value all types of diversity. We're an equal opportunity employer and believe that our differences create a vibrant, authentic working culture. We want all our colleagues to feel able to bring their whole selves to work. We don't discriminate on the basis of protected characteristics or identities. We make sure that every job is crafted to be inclusive and that people with disabilities or caring responsibilities can take part in the application and interview process. Tell us if you need accommodations: We'll put reasonable adjustments in place to support you. We work with Textio to make our job design and hiring inclusive. Permanent