Data Engineer

IXceed Solutions
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
€ 50K

Job location

Tech stack

Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
JIRA
Databases
Information Engineering
Data Governance
Github
Python
SQL Databases
YAML
Data Processing
Databricks

Requirements

Do you have experience in SQL?, * 5+ years of experience in data engineering architecture, data governance, and data processing.

  • At least 2 to 3+ years as a Databricks SQL data engineer on AWS for a large/high volume project.
  • Experience of supporting Enterprise Databricks deployments especially with regards to usage of SQL Notebooks, Workflows/Jobs, DABs, DLT, Delta/Iceberg, Python, and YAML.
  • Experience working with the AWS platform (especially S3) and liaising with other internal infrastructure support teams to achieve together.
  • Awareness of working with customer profiles, PII, and GDPR sensitive data.
  • Any experience working on CRM-related projects (i.e. Customer360) would be preferred.
  • Must be able to write SQL queries, functions, procedures…etc. to achieve the hypothesis.
  • Must be mindful of the performance and other aspects of the solution presented to your team.
  • Implement and maintain database code in the form of tables, scripts, queries, views, triggers, etc.

Process Skills:

Must know end-to-end data engineering pipeline development, capturing business requirements, ensuring data quality, and ongoing maintenance of pipelines.

Behavioral Skills:

Good communication skills in English; Collaborative team player; Self-starter; Excellent documentation and presentation skills; Continuous learner and advocate for Databricks usage; Experience working in an Agile Team (GitHub, Jira, MS Teams is used).

Certification: Any relevant AWS and/or Databricks certifications

Apply for this position