> Markdown version of [/jobs/ext/2984401-software-engineer](https://www.wearedevelopers.com/jobs/ext/2984401-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer

- **Company:** Barcelona Supercomputing Center
- **Location:** Barcelona, Spain
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Computational Linguistics, Distributed Computing Environment, Fault Tolerance, Python (Programming Language), Language Modeling, Node.Js, Tokenization, Pytorch, Large Language Models, Deep Learning, Information Technology, Data Pipelines
- **Published:** September 18, 2026
- **Apply:** https://www.adzuna.es/contact-us.html

## About the Role

Design and implement distributed training strategies (data, tensor, pipeline, and sequence parallelism, ZeRO/FSDP) to scale training efficiently across hundreds to thousands of GPUs.Apply scaling laws to guide compute?optimal decisions on model size, dataset size, and training budget.Research and prototype novel model architectures (e.G. Mixture?of?Experts, alternative attention/state?space mechanisms) for pre?training at scale.Optimize data pipelines, tokenization and curriculum design for multilingual, multi?node pre?training.Collaborate closely with HPC infrastructure teams to maximize cluster utilization, fault tolerance and checkpointing at scale.Mentor junior team members on best practices for distributed pre?training and performance bottleneck identification.RequirementsEducationPhD or Master's degree in Computer Science, Artificial Intelligence or a related field.Essential Knowledge and Professional ExperienceExtensive experience in pre?training large language
models, including multi?node, multi?GPU distributed training.Proven expertise with distributed training frameworks such as Megatron?LM, DeepSpeed, PyTorch FSDP or NeMo.Expert knowledge of Python and Deep Learning libraries including PyTorch and DeepSpeed.Solid understanding of scaling laws and compute?optimal training strategies.Experience with large?scale distributed training and high?performance computing (HPC) environments.Excellent level of English (written and spoken).
Additional Knowledge and Professional ExperienceHands?on experience with European Tier?0 HPC clusters such as MareNostrum, Leonardo, or JUPITER (or equivalent large?scale supercomputing environments) will be considered a significant asset.Fluency in Spanish is highly valued.Knowledge of one or more of Spain's co?official languages, including Catalan, Basque and Galician is highly desirable.CompetencesAbility to optimize complex technical workflows to reduce resource consumption and iteration time.Technical leadership skills to establish best practices in training within the group.Strong problem?solving skills focused on performance bottlenecks and scalability.Collaborative mindset and ability to work closely with the agents and infrastructure teams.ConditionsThe position will be located at BSC within the Directors DepartmentWe offer a full?time contract (35h/week), a good working environment, a highly stimulating environment with state?of?the?art infrastructure

## Description

In this context, the newly created AI Institute is looking for talent to help design and improve its pre?training operations and infrastructure.The Language Modeling Team is looking for candidates with a background in computational linguistics with experience in Language Technologies, specifically in Deep Learning and large language model building, and possibly in other areas of Natural Language and Speech Processing.The successful candidate will work in a highly sophisticated HPC environment, have access to state?of?the?art systems and computational infrastructures, and establish collaborations with experts in different areas at the local and international levels.The researcher will implement innovative techniques for language modeling and evaluation in the HPC environment.Key DutiesLead the technical design and execution of large-scale pre?training pipelines for multilingual foundation models on multi?node HPC infrastructure (MareNostrum, Leonardo, JUPITER and
other EuroHPC systems)., flexible working hours, extensive training plan, restaurant tickets, private health insurance, support to the relocation proceduresDuration: Open?ended contract due to technical and scientific activities linked to the project and budget durationHolidays: 22 days of holidays + 6 personal days + 24th and 31st of December per our collective agreementSalary: we offer a competitive salary commensurate with the qualifications and experience of the candidate and according to the cost of living in BarcelonaStarting date: 01/09/2026Development of the recruitment processThe selection will be carried out through a competitive examination system ("Concurso-Oposición").
The recruitment process consists of two phases:Curriculum Analysis: Evaluation of previous experience and/or scientific history, degree, training, and other professional information relevant to the position.

 - 40 pointsInterview phase: The highest?rated candidates at the curriculum level will be invited to the interview phase, conducted by the corresponding department and Human Resources.
In this phase, technical competencies, knowledge, skills, and professional experience related to the position, as well as the required personal competencies, will be evaluated.

 - 60 points.
A minimum of 30 points out of 60 must be obtained to be eligible for the position.The recruitment panel will be composed of at least three people, ensuring at least 25% representation of women.In accordance with OTM?R principles, a gender?balanced recruitment panel is formed for each vacancy at the beginning of the process.
After reviewing the content of the applications, the panel will begin the interviews, with at least one technical and one administrative interview.
At a minimum, a personality questionnaire as well as a technical exercise will be conducted during the process.The panel will make a final decision, and all individuals who participated in the interview phase will receive feedback with details on the acceptance or rejection of their profile.At BSC, we seek continuous improvement in our recruitment processes.
For any suggestions or comments/complaints about our recruitment processes, please contact ****** vacancy will remain open until a suitable candidate has been hired.
Applications will be regularly reviewed and potential candidates will be contacted.OTM?R principles for selection processesBSC?CNS is committed to the principles of the Code of Conduct for the Recruitment of Researchers of the European Commission and the Open, Transparent and Merit?based Recruitment principles (OTM?R).
This is applied for any potential candidate in all our processes, for example by creating gender?balanced recruitment panels and recognizing career breaks etc.BSC?CNS is an equal opportunity employer committed to diversity and inclusion.
We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or any other basis protected by applicable state or local law.
Inscribirse en esta oferta
Recibir ofertas similares por correo electrónico
Al crear una alerta, aceptas nuestros Términos y condiciones y Política de privacidad, y el uso de cookies.


## Related Videos

- [Geometric deep learning for drug discovery](https://www.wearedevelopers.com/videos/264-geometric-deep-learning-for-drug-discovery)
- [Stop using Node.js like in 2020! What changed and what you can do today with Node.js](https://www.wearedevelopers.com/videos/100011-stop-using-node-js-like-in-2020-what-changed-and-what-you-can-do-today-with-node-js)
- [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding)
- [When Value Becomes Programmable: A Developer's Guide to Tokenization](https://www.wearedevelopers.com/videos/100276-when-value-becomes-programmable-a-developer-s-guide-to-tokenization)
- [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models)
- [The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)](https://www.wearedevelopers.com/videos/2067-the-gashlycrumb-tinies-of-ai-networking-you-must-know-or-languish)

## Related Articles

- [Spanish Business Culture and Etiquette](https://www.wearedevelopers.com/magazine/353-spanish-business-culture-and-etiquette)
- [Top 6 Hackathons for Developers in 2023](https://www.wearedevelopers.com/magazine/263-top-6-hackathons-for-developers-in-2023)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [5 Best Emerging Tech Cities in Europe](https://www.wearedevelopers.com/magazine/361-5-best-emerging-tech-cities-in-europe)