Big Data Software Engineer
Role details
Job location
Tech stack
Job description
You will play a major role in the evolution of non-relational data stores and big data platforms, based on technologies such as Hadoop and Spark. You will apply your software engineering expertise to large and long-lived data platforms, high-throughput ingestion pipelines, performance- critical access patterns, and demanding reliability requirements. Your work will directly support the operation, monitoring, and analysis of particle accelerator systems through the management of multi-petabyte datasets accumulated over many years., * Drive the evolution of the CERN Accelerator Archival system (NXCALS).
- Design and develop the core components of the system, including ingestion pipelines (ETL), metadata services, data compaction mechanisms, data extraction algorithms, and APIs.
- Collaborate with different user communities to define and promote best practices for using NXCALS in the development of control applications for the CERN Control Centre.
- Work closely with the CERN IT department to select and validate evolution of the underlying storage technologies (e.g. HDFS, ClickHouse)., * You are a national of a CERN Member State or Associate Member State . Currently, we cannot consider applications from Pakistani and Lithuanian nationals for positions with a 2026 start date, as the ceiling defined under Article II.5 of the Associate Membership Agreement has been reached.
Requirements
- Extensive experience in Java development using the Spring ecosystem.
- Solid knowledge of big-data technologies, including Hadoop, HDFS or Apache Ozone, HBase or ClickHouse, Apache Spark, and Kafka.
- Working knowledge of Python, including SDK development and PySpark.
- Proven experience with modern software engineering practices, including quality assurance, CI/CD, and DevOps methodologies.
Your skills
- Knowledge of programming techniques and languages (java and Python).
- Architecture and design of ICT systems.
- Identification and selection of relevant emerging ICT technologies.
- Conceptualising, designing and developing user experiences and interfaces.
Benefits & conditions
- A minimum entry-salary of 9236 Swiss Francs per month (tax free), increasing in line with your years of relevant experience.
- 30 days of paid leave per year plus 2 weeks annual closure.
- Coverage by CERN's comprehensive health insurance scheme (for yourself, your spouse and children), and membership of the CERN Pension Fund.
- Family, child and infant monthly allowances depending on your individual circumstances.
- A relocation package (installation grant, removal, travel expenses) depending on your individual circumstances.
- Possibility to extend your contract up to 8 years + eligibility for indefinite contract tenure.