> Markdown version of [/jobs/ext/4092178-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/4092178-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** N-iX
- **Location:** Spain
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), 3d Models, Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Data Analysis, Computer Vision, Microsoft Azure, BigQuery, Cloud Computing, Cloud Storage, Computer Programming, Databases, Continuous Integration, Data Deduplication, Extract Transform Load (ETL), Data Transformation, Data Vault Modeling, Dimensional Modeling, Data Flow Control, Github, Python (Programming Language), Metadata, Query Optimization, Search Technologies, SQL Databases, Google Cloud, Delivery Pipeline, Snowflake, Change Data Capture, Indexer, Web Filtering, Low Latency, Search Engines, Data Management, Feature Extraction, Vertica, Oracle Cloud Infrastructure, Data Pipelines, Serverless Computing
- **Published:** October 14, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=c432e48d83ee73e8

## About the Role

Primary Tech Stack: GCP, ClickHouse, Snowflake, dbt Core, Apache Airflow, Python, SQL., * Google Cloud Platform (GCP): 4+ years of production experience with core GCP data technologies (BigQuery, Dataflow, Cloud Pub/Sub, GKE, Google Cloud Storage).

 * Database & Query Engines: Deep technical proficiency with both Snowflake (warehousing, semi-structured queries, integration layers) and ClickHouse (real-time aggregation, low-latency columnar storage, indexing).
 * Enterprise ETL / CDC: Proven experience architecting CDC pipelines and incremental delta loading for multi-terabyte dataset scale.
 * Data Transformation & Orchestration: Hands-on mastery of dbt Core/Cloud and Apache Airflow in an enterprise CI/CD setting (e.g., GitHub Actions).
 * Programming Skills: Advanced skills in Python and SQL; familiarity with Go, Java, or Scala is a strong plus., * Experience with Data Vault 2.0 architecture, hash-key generation, and raw/staging/integration layer design.
 * Background handling AI/ML metadata, computer vision feature vectors, C2PA provenance headers, or semantic search configurations.
 * Familiarity with media metadata schemas (images, 3D model stems, video derivatives).
 * Experience with other major cloud providers such as AWS, Azure, or Oracle Cloud.

## Description

1. Ingestion Architecture & GCP Foundation:
 * Architect, build, and optimize scalable job creation, batching, and high-throughput ingestion pipelines hosted on GCP.
 * Implement serverless and containerized data pipelines using GCP infrastructure (BigQuery, Dataflow, Pub/Sub, Cloud Storage, GKE).

 2. Enterprise ETL, CDC & Incremental Processing:
 * Design robust Change Data Capture (CDC) and incremental update workflows to enable fast delta synchronization across platforms.
 * Build dbt transformation models and Airflow orchestrations following Data Vault / dimensional modeling patterns.
 * Implement delta tracking methods (e.g., hash keys, hash diffs) to track row-level asset modifications and metadata events.

 3. Multi-Engine Analytics & Query Optimization:
 * Maintain and optimize Snowflake integration layers, handling deduplication logic, canonical content filtering, and policy restrictions.
 * Deploy and manage ClickHouse as a high-concurrency analytical engine to deliver sub-second metadata retrieval and indexing.
 * Construct dedicated integration views and API query layers allowing internal and external clients to consume real-time delta updates.

 4. Data Quality, Governance & Scalability:
 * Enforce metadata schema standardization, canonical asset mapping, and automated validation layers across diverse asset types (images, video, 3D models, audio).
 * Collaborate closely with cross-functional teams to integrate metadata pipelines with feature extraction tools, search indexes, and licensing platforms., Key Success Metrics (First 90 Days)
 * GCP Pipeline Optimization: Standardize ingestion batching and pipeline compute infrastructure on GCP.
 * ClickHouse & Snowflake Integration: Establish streamlined integration views exposing low-latency metadata delta changes.
 * Automated CDC Workflows: Finalize automated dbt delta transformations with hash tracking across primary warehouse layers.