Data Engineer

CluePoints
Belgium
25 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Audit Trail Automation of Tests Microsoft Azure Clinical Data Repository Software Documentation Code Review Continuous Integration Data Architecture Information Engineering Data Governance Data Infrastructure
+12 more
Graph Database Data Streaming Management of Software Versions Retrieval-Augmented Generation Snowflake Generative AI Git Data Layers Data Lakes Core Data Software Version Control Databricks

Job description

You will work with the platform architect and the AI Engineer to turn the architecture into reliable, production-grade data flows. Success looks like trustworthy, traceable, harmonized snapshots, delivered consistently across studies and data sources., * Build and maintain production pipelines that bring data from different studies and applications into the data layer.

  • Implement harmonization logic that reconciles studies with differing variables, including approaches driven by metadata from data-capture solutions.
  • Produce harmonized data snapshots for CluePoints’ consumer applications, with clear refresh and versioning approaches.
  • Validate new or changed data flows against source systems and business expectations.

Connectors & Integration

  • Shape and build connector approaches for common data-capture systems.
  • Support customer-specific Databricks and Snowflake environments with secure, repeatable integration patterns.
  • Monitor and manage schema changes, missing data, duplication and inconsistencies between sources.
  • Evaluate new data sources and determine the most appropriate extraction and integration approach.

Auditability, Quality & Compliance

  • Ensure snapshots support auditability, traceability and regulatory compliance, including lineage, versioning and reproducibility.
  • Implement automated data-quality controls covering completeness, accuracy, consistency, uniqueness and freshness.
  • Set up monitoring and alerting for pipeline failures, unexpected schema changes and data-quality issues.
  • Apply testing, validation and documentation standards appropriate to a regulated environment.

Platform Engineering & Collaboration

  • Contribute to technology evaluation and architecture decisions with the platform architect.
  • Establish version control, code review, automated testing, CI/CD and orchestration practices for the data layer.
  • Monitor and optimize performance, resource usage and cost.
  • Work with the AI Engineer to make well-described, harmonized data available to retrieval and AI components.
  • Document critical solutions and share knowledge to avoid dependency on a single individual

What We Offer

  • The chance to build a core data capability from the ground up: CluePoints has committed to the data layer, and the engineering patterns are still to be set.
  • A meaningful technical challenge: harmonizing data across studies with differing variables into auditable snapshots.
  • Input into technology choices, with room to evaluate options rather than inherit a fixed stack.
  • Close collaboration with a senior platform architect and an AI Engineer on a shared problem.
  • Direct visibility of how your pipelines and snapshots power CluePoints’ consumer applications.
  • Exposure to customer-specific Databricks and Snowflake environments across the life sciences industry.

Requirements

  • Strong practical experience designing and running production-grade ingestion, transformation and orchestration pipelines.
  • Advanced SQL and strong Python development skills.
  • Hands-on experience with Databricks and/or Snowflake and modern lakehouse or warehouse architectures.
  • Experience integrating data from databases, APIs and SaaS applications.
  • Strong data modelling skills, including layered data architectures.
  • Experience with Git-based development, code review, automated testing and CI/CD.
  • Experience implementing data-quality controls, observability, monitoring and alerting.
  • Understanding of data governance, metadata, lineage and traceability, and why they matter in regulated settings.
  • Ability to reconcile data with differing structures and variables and to validate it against source systems.
  • High autonomy and ownership from requirements through deployment, monitoring and maintenance.

Nice To Have

  • Experience in clinical trials, life sciences or another regulated environment, or familiarity with clinical data standards (for example CDISC) and data-capture system exports.
  • Experience designing metadata-driven pipelines or harmonizing data across heterogeneous sources.
  • Experience with Delta Lake, Unity Catalog and Databricks Asset Bundles, and with Microsoft Azure.
  • Experience building integrations into customer-managed data environments.
  • Practical use of generative AI in data engineering workflows, and awareness of knowledge graphs and RAG.

Benefits & conditions

*

  • Health Insurance through Alan (100% hospitalisation cover, 80% ambulatory and dental)
  • Mobility Budget for eco-transport, housing, or car allowance (flexible 3-pillar system)
  • Group Insurance Plan with 6-12% employer pension contribution based on seniority
  • Meal Vouchers (€8/day) and Eco Vouchers for sustainable purchases
  • A hub-based hybrid model that blends flexibility with purpose - connecting teams through collaboration, learning, and a vibrant social culture. Equal Opportunities & GDPR NoticeCluePoints is an equal opportunities employer. We value and respect diversity in our workforce and do not tolerate discrimination based on gender, age, disability, ethnic origin, religion, sexual orientation, or any other protected ground under Belgian law. Personal data collected as part of your application will be processed in compliance with the EU GDPR and Belgian data protection legislation. You have the right to access, correct, or delete your personal data at any time by contacting privacy@cluepoints.com. Optional Global Add-OnAt CluePoints, we believe that diverse teams make better decisions and drive innovation. We’re committed to building a workplace that reflects the communities we serve and where everyone can thrive.

About the company

The Data Engineer will build the pipelines, connectors and harmonized data snapshots at the heart of CluePoints’ new data layer. The layer brings together data from different studies and applications so that CluePoints’ consumer applications can use it, with auditability and regulatory compliance designed in from the start.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…