Data Platform Architect - Apache Iceberg Lakehouse
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+23 more
Job description
We are seeking a hands-on Principal Data Platform Architect to lead the design, implementation, and operationalization of an enterprise Apache Iceberg Lakehouse platform. This role combines enterprise architecture with deep platform engineering experience to build a scalable, cloud-native data platform supporting analytics, AI/ML, GenAI, streaming, and governed data products., Define enterprise Lakehouse architecture, standards, governance, and implementation roadmap.
Design and build Apache Iceberg-based bronze, silver and gold data layers.
Develop ingestion frameworks for batch, streaming, CDC, APIs, and event-driven integrations.
Build scalable Spark, Flink, Kafka, dbt, SQL, and Python pipelines.
Implement metadata management, cataloging, lineage, RBAC, encryption, and data quality.
Optimize partitioning, compaction, snapshots, metadata, and query performance.
Enable AI-ready semantic layers, feature engineering, RAG, and GenAI workloads.
Implement Infrastructure as Code, CI/CD, monitoring, and observability.
Requirements
Apache Iceberg, Spark, Flink, Kafka, dbt, Trino, Snowflake, Databricks
AWS, Azure, or Google Cloud
Python, Scala, SQL, Java
Kubernetes, Docker, Terraform
Airflow, Dagster, or Prefect
Polaris, Unity Catalog, Glue Catalog, Apache Nessie
Preferred Qualifications:
12+ years designing enterprise data platforms.
Experience implementing Lakehouse architectures at enterprise scale.
Experience with petabyte-scale environments and AI/ML platforms.
Success Measures:
Deliver a production-ready Apache Iceberg Lakehouse.
Establish governance, data quality, and enterprise standards.
Enable self-service analytics and AI-ready governed data products.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦