Data Engineer Partner

Open Partners
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Tech stack

Microsoft Excel
API
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Google BigQuery
Cloud Engineering
Data Architecture
Information Engineering
Data Governance
Data Infrastructure
Data Integration
ETL
Data Warehousing
Database Design
Database Storage Structures
Github
Python
SQL Databases
Data Streaming
Technical Data Management Systems
Google Cloud Platform
Prompt Engineering
Data Management
Software Version Control
Data Pipelines
Api Management

Job description

The Data Engineer is responsible for developing and maintaining the infrastructure behind our data pipelines and data warehouses. You will lead the design and delivery of internal and external data engineering solutions, managing the development of transformation pipelines across our data architecture.

Role Responsibilities

  • Develop the tech stack and data architecture behind the agency's automated reporting infrastructure. Research, analyze, and help implement technical approaches for solving complex development and integration problems to support the strategy roadmap

  • Build and maintain ETL/ELT pipelines to create high-performance data feeds for reporting suites across organic & paid media.

  • Lead the process on troubleshooting data feeds, understanding and solving problems across various data platforms and technologies (e.g., API failures, data discrepancies).

  • Work closely with the AI & automation team to ensure that clean and structured data can be successfully imported from key systems and applications around the business.

  • Champion best practice, governance, and security in all data-led projects.

  • Support the AI team to scope out new opportunities for utilizing Artificial Intelligence in product development and engineering workflows.

  • Speak directly with clients regarding technical data requirements and manage high-level stakeholder expectations regarding data feasibility.

Your KPIs / Outputs

  • Design and maintain a scalable data architecture and tech stack to power automated reporting .
  • Ensure high-quality, normalized data availability by building and stabilizing ETL/ELT pipelines .
  • Minimize data feed downtime and troubleshooting requirements through robust engineering.
  • Champion data governance, security, and best practices across all data-led projects.
  • Enable faster delivery of client solutions by automating complex data integration from key platforms.
  • Drive the technical roadmap for integrating data pipelines & warehousing across the wider business.

Role Details

Reports to: Harry Smith (Data Senior Partner)

Responsible for: Architecture, development, and maintenance of our reporting pipelines, data warehousing, and database structures.

Requirements

Do you have experience in SQL?, * 5+ years of experience in data engineering and building data pipelines/architecture.

  • Good strategic thinkers, with the ability to undertake strategic planning for data infrastructure and roadmaps.
  • Able to take the lead of a function (Data Engineering) and make it your own, championing governance and security.
  • Self-motivated and proactive in researching and implementing new technical approaches.
  • Confidence in translating technical concepts, with the ability to communicate complex integration problems to non-technical stakeholders clearly.

Skills & Experience required:

Must Have:

  • Advanced SQL & Python.
  • Cloud Engineering (e.g., AWS, Azure, GCP).
  • Database design and architecture principles.
  • High level of Microsoft Excel / Google sheets skills.
  • Intermediate A.I./prompt engineering knowledge.

Desirable:

  • Experience with Google Cloud Platform (GCP) and BigQuery.
  • Experience in marketing (offline and online) data.
  • Advanced coding/version control skills (e.g. GitHub).
  • Experience with marketing API management tools (e.g., Adverity, Fivetran, Funnel)

Apply for this position