Senior Data Engineer

Link Group
Poland, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Poland, United States of America

Tech stack

Adaptable Database Systems
API
Agile Methodologies
Airflow
Automation of Tests
Google BigQuery
Continuous Delivery
Continuous Integration
Data Integrity
ETL
Data Systems
Data Vault Modeling
JSON
Parsing
Standard Sql
DataOps
Simple Object Access Protocol (SOAP)
SQL Databases
XML
Freeform SQL
File Transfer Protocol (FTP)
Cloud Platform System
Data Ingestion
Snowflake
SOAPAPI
GIT
REST
Code Restructuring
Software Version Control

Job description

  • Design, implement, and maintain scalable data models using Star, Snowflake, and Data Vault methodologies.
  • Build ELT/ETL pipelines and deploy robust data ingestion and transformations (primarily using GCP Data Fusion/Apache Airflow).
  • Optimize BigQuery: write, refactor, and optimize complex SQL queries with a focus on cost reduction, performance, and concurrency.
  • Integrate diverse sources: connect and wrangle data from RESTful/SOAP APIs and SFTP servers, handling JSON, CSV, and XML formats.
  • Drive DataOps culture: collaborate within an Agile framework using Git and CI/CD pipelines to ensure automated testing and continuous delivery of data solutions.

Requirements

  • SQL
  • BigQuery
  • GCP Data Fusion
  • Data modeling
  • Inmon
  • Data Vault
  • API
  • Data
  • JSON
  • XML
  • CSV
  • REST
  • SOAP
  • Git
  • CI/CD
  • Angielski
  • Data Major
  • 3+ years of expert-level SQL & BigQuery hands-on experience (complex optimization, cost control, data integrity).
  • 3+ years of experience in ELT/ETL pipeline development using GCP Data Fusion (highly preferred) or Apache Airflow.
  • Strong expertise in Data Modeling & Architecture - deep understanding of Kimball/Inmon concepts and hands-on experience with Data Vault (major plus).
  • API & Data Ingestion proficiency - proven track record of ingesting and parsing JSON, XML, and CSV data from REST/SOAP endpoints.
  • Git & CI/CD fluency - practical knowledge of version control and continuous testing/delivery tools in cloud environments.
  • Architect & Model: Design, implement, and maintain scalable data models using Star, Snowflake, and Data Vault methodologies.
  • Start ASAP

Apply for this position