Data Management Engineer - DestinE Data Services
Role details
Job location
Tech stack
Job description
We are looking to fill a new role Data Management Engineer (A2) focused on providing management and support of operational data services for the Digital Twins (DTs) implemented in the Destination Earth initiative (DestinE) of the European Commission. These data services, part of the Digital Twin Engine (DTE), allow to produce, manage and enable tailored access to the weather-induced extreme and climate change adaptation digital twin data (Extremes and Climate DTs). They are deployed and in Phase 3 of DestinE will be operated on a range of distributed infrastructures, including the EuroHPC supercomputers, the ECMWF's HPC facility, the data bridges part of the DestinE data lake, and the DestinE platform. These data services require robust management and tightly controlled evolution cycles to maintain a high-level of service.
This role will join a team of data and software engineers in the Production Section in the Forecast and Services Department, that manage data services at ECMWF. It will enhance and ensure the sustained operational performance of data services for the DestinE digital twins, such as FDB, Aviso and Polytope. More specifically, it will build and operate specific testing frameworks for pre-operational integration; deploy new data services or upgrades to existing services into the operational environment by working closely with teams developing the data services. It will also support user-reported issues together with User Services teams and collaborate with ECMWF partner organisations which contribute to implementing the digital twins, EUMETSAT and/or ESA and their contractors when necessary. Finally, it will improve observability leading to enhanced monitoring and performance as well as facilitating capacity planning., * Supporting the data handling requirements for the DestinE infrastructure (in particular the data bridges) and ECMWF HPC. Specifically, the management of data services (such as FDB, Aviso and Polytope), including pre-operational testing and deployment of evolutions and upgrades of these services.
- Ensuring robust data services are in place to serve DestinE Climate and Extremes DT data generated to the DestinE user community.
- Collaborating with EUMETSAT and ESA on the interfaces to the DestinE infrastructure (Data Lake and Service Platform).
- Collaborating with the Development Section, User Services and Research teams at ECMWF, and with external partners, on evolving the data services for the DestinE digital twins.
- Working closely with, and supporting where necessary, the Data Governance activities related to DestinE output data and building knowledge of the data format standards involved (GRIB, NetCDF and others)
- Contribute to the reporting of service status and evolution to external stakeholders.
Requirements
Do you have experience in UNIX?, Do you have a Bachelor's degree?, * Excellent analytical and problem-solving skills with a proactive continuous improvement approach
- Ability to work with precision and care and having a good awareness of the need to test thoroughly and document changes appropriately
- Excellent interpersonal and communication skills are vital, to communicate with a wide range of both technical and non-technical colleagues at ECMWF and in partner organisations.
- Dedication and enthusiasm to work as part of a team, taking initiative to work collaboratively with other team members and project partners
- Ability to at times work independently, but to know when it is important to seek advice
- Active listener who seeks and respects the views of others
- Highly organised with the capacity to work on a diverse range of tasks to tight deadlines
- Flexibility, with a willingness to adapt plans if partner organisations work at different paces, and if priorities shift over time
Your profile
- A university degree (EQF Level 6 or above) or equivalent professional experience is required
- Programming skills with scripting languages (such as Python or Bash) in a UNIX/Linux environment required
- Experience in an operational or time-critical environment would be desirable
- Some work experience in a scientific environment would be advantageous
- An understanding of Numerical Weather Prediction (NWP) would be advantageous
- Knowledge of standardised data formats for international exchange would be advantageous
- Experience curating large scientific datasets would be advantageous
Candidates must be able to work effectively in English; knowledge of one of the Centre's other working languages (French or German) is an advantage.