Data Catalog Implementation Specialist

Michael Page International (Deutschland) GmbH
Düsseldorf, Germany
4 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote
Düsseldorf, Germany

Tech stack

Unity
API
Data Governance
Hive
Python
Metadata
Meta-Data Management
Open Source Technology
SQL Databases
Scripting (Bash/Python/Go/Ruby)
Data Lake
GraphQL
Data Management
Databricks

Job description

  • Pilot Configuration:
  • Deploy and configure the initial instance of the data catalog (e.g., Atlan or DataHub) to support a Proof of Concept (PoC) scope. Work with the DataHub open-source framework within our ecosystem.
  • Needs Assessment:
  • Consult on how effectively the data catalog meets organizational requirements and identify gaps.
  • Databricks Integration:
  • Establish secure connectivity between the data catalog and Databricks Unity Catalog/Delta Lake to automate ingestion of schemas, tables, and views.
  • Metadata Enrichment:
  • Execute automated metadata extraction and implement tagging strategies to classify sensitive data (PII) and add business context (descriptions, owners).
  • User Onboarding:
  • Design a streamlined workflow enabling Data Scientists to search, query, and request access to datasets directly through the catalog interface., * Data Cataloging

Requirements

  • Proven experience configuring modern data governance platforms, specifically Atlan and/or DataHub.
  • DataHub Open Source Framework:
  • Hands-on knowledge of the DataHub open-source catalog framework.
  • Data Platforms:
  • Strong proficiency with Databricks (Lakehouse architecture, Delta Lake, Unity Catalog) and Spark SQL.
  • Metadata Management:
  • Expertise in metadata ingestion frameworks, API-based integration (REST/GraphQL), and automated classification policies.
  • Scripting:
  • Proficiency in Python or SQL for custom connector configuration and metadata manipulation.
  • Governance:
  • Familiarity with data stewardship principles, including ownership assignments, glossary creation, and certification workflows.

About the company

Wenn Du außerdem wissen möchtest, ob der Standort des Jobs LGBTQ-freundlich ist, frage gerne nach unserem Pride@Page-Komitee-Kontakt für ein vertrauliches Gespräch und/oder schaue Dir diese Ressource an: https://www.iglta.org/destinations/travel-guides/lgbtq-safety-guide/. PageGroup ermutigt Mitglieder der LGBTQ-Gemeinschaft, sich auf interne Stellen zu bewerben; wir können zwar die lokalen Gesetze und Gepflogenheiten nicht ändern, aber wir werden alles tun, was wir können, um Dich auf Deine nächste Aufgabe vorzubereiten und ggf. einen Standort zu finden, der für Dich und Deine Angehörigen geeignet ist.

Apply for this position