Data Engineer (IT-DA-ASM-2025-255-LD)
Role details
Job location
Tech stack
Job description
You will join the Analytics, Streaming and Monitoring section which provides Messaging, data Streaming, Monitoring platforms and services, and frontend analytics services for the different CERN communities to facilitate data collection, transport, manipulation, processing, interactive data analysis and central reporting solutions. Moreover, the section works with the Experiments, Accelerator sector, IT and other CERN communities interested in implementing data analysis solutions with these technologies., As a Data Engineer in the Database and Analytics Group, your main activities will consist of:
- Service management for the Messaging and Data Streaming Services:
- Develop and implement service standards and procedures to ensure efficient and effective delivery of messaging services. Oversee messaging infrastructure.
- Create and maintain solutions for data streaming use cases.
- System administration and support of the monitoring infrastructure and applications by offering metrics, logging, alerting and visualisation tools.
- Contributing to the operations of other services in the section, such as the interactive analytics infrastructure (SWAN, Jupyter Notebooks) and the Data Integration and Reporting services.
- Consultancy, assistance and advice to end users developing data pipelines and monitoring use-cases.
- Sharing domain and technical expertise, providing technical mentorship and training to peers.
- Consultancy, assistance and advice to end users developing analytics use-cases, * Work during nights, Sundays and official holidays, when required by the needs of the Organisation.
- Stand-by duty, when required by the needs of the Organisation.
- Sporadic attendance to international workshops and conferences in the future
Requirements
- Master's degree or equivalent experience in Computing Science.
- Technical skills in Apache ActiveMQ and Kubernetes operations.
- Strong programming knowledge in UNIX shell and Java., Master's degree or equivalent relevant experience in the field of Computing Science or any related field with significant Computing content or a related field., The successful candidate should have demonstrated experience in following fields:
- Technical and troubleshooting skills with Apache ActiveMQ, Apache Kafka, RabbitMQ and/or equivalent technologies.
- DevOps operations (Linux systems) and configuration management experience (e.g. Ansible, Puppet, Helm) in Agile development environments and/or cloud native deployments, including tool development, packaging and deployment in Python and Java ecosystems.
- Operation of large-scale production Kubernetes environments, including monitoring (for example using Prometheus for metrics) and CI/CD solutions like ArgoCD.
- Technical and troubleshooting skills with Kubernetes components, web interfaces and backend stacks, as well as performance and networking debugging on the Linux platform.
Technical competencies:
- Knowledge of system configuration tools: familiarity with automation tools for infrastructure delivery and management.
- Knowledge of programming techniques and languages: UNIX shell script and Java programming is required; Python knowledge would be an advantage.
- Knowledge of operating systems, such as Linux.
- Capturing and analysis of requirements for ICT systems: ability to collect the needs of users and to manage the different phases of a project.
- Architecture and design of ICT systems: distributed applications and services
Behavioural competencies:
- Solving Problems: identifying, defining and assessing problems, taking action to address them.
- Achieving Results: delivering high quality work on time and fulfilling expectations.
- Working in Teams: building and maintaining constructive and effective work relationships.
- Demonstrating Flexibility: readily absorbing new techniques and working practices; proposing new or improved ways of working.
- Learning and Sharing Knowledge: keeping up-to-date with developments in own field of expertise and readily absorbing new information.
Language skills:
- Spoken and written English, with a commitment to learn French.