Data Engineer
Role details
Job location
Tech stack
Job description
As a Data Engineer, you design and develop data processing for data migration and the creation of business datamarts. To accomplish your tasks, you rely on technologies such as SQL, Python, MongoDB, as well as orchestration tools like Airflow.
You join a team of 12 people and independently participate in a large-scale national project aimed at breaking down the silos of medical data from the five Swiss university hospitals to create a national network of interoperable, secure health data dedicated to medical research. In this context, you exchange and participate in defining the format of common data.
You ensure the integration of data from multiple sources (databases, data warehouses, API microservices, Kafka streams), while guaranteeing their quality, consistency, and integrity. In this regard, you implement monitoring mechanisms for data pipelines and ensure their performance, especially with large volumes. Your role also involves rigorous validation of data quality with business teams, implementing tools to facilitate data extraction and exploitation, as well as compliance with ethical, regulatory, and data protection standards.
Finally, thanks to your adaptability and autonomy, you successfully evolve in a dynamic and stimulating environment to carry out your projects.
Requirements
You hold a Master's degree in computer science or an equivalent qualification, and you have at least two years of professional experience as a Data Engineer, during which you have led end-to-end projects, ideally in environments with high data volumes.
Knowledge of the medical field or hospital information systems is a significant asset. Similarly, familiarity with medical data coding standards such as SNOMED, ATC, or LOINC will be particularly appreciated in the projects undertaken.
You have strong skills in Python and SQL development applied to data engineering, as well as good mastery of relational and document databases, notably MongoDB.
You also have significant experience with pipeline orchestration tools such as Airflow, as well as in implementing monitoring and optimisation mechanisms for data pipelines (DataOps), ensuring their performance and robustness.
You understand microservices architectures and their impact on data flows, and you are comfortable with REST API integration as well as managing real-time data streams via Kafka. Furthermore, you master good development practices, including CI/CD processes, and the use of collaborative tools such as Bitbucket and Jira.
You possess excellent writing skills in French, allowing you to clearly document your work and synthesise complex information. You also have a good level of professional English.
On a relational level, you stand out for your ability to collaborate with members of different teams within the DTN-IA and nationally within the project framework. You favour clear and constructive communication, promoting the exchange of best practices, mutual support, and continuous improvement within the team.
You adopt a rigorous and thoughtful approach that guarantees data quality while managing priorities professionally. When faced with challenges, you demonstrate autonomy in seeking information and favour a solution-oriented approach.
You have a mindset ready to take on challenges in a demanding and complex environment.