Data Engineer
IXceed Solutions
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Intermediate Compensation
€ 50KJob location
Tech stack
Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
JIRA
Databases
Information Engineering
Data Governance
Github
Python
SQL Databases
YAML
Data Processing
Databricks
Requirements
Do you have experience in SQL?, * 5+ years of experience in data engineering architecture, data governance, and data processing.
- At least 2 to 3+ years as a Databricks SQL data engineer on AWS for a large/high volume project.
- Experience of supporting Enterprise Databricks deployments especially with regards to usage of SQL Notebooks, Workflows/Jobs, DABs, DLT, Delta/Iceberg, Python, and YAML.
- Experience working with the AWS platform (especially S3) and liaising with other internal infrastructure support teams to achieve together.
- Awareness of working with customer profiles, PII, and GDPR sensitive data.
- Any experience working on CRM-related projects (i.e. Customer360) would be preferred.
- Must be able to write SQL queries, functions, procedures…etc. to achieve the hypothesis.
- Must be mindful of the performance and other aspects of the solution presented to your team.
- Implement and maintain database code in the form of tables, scripts, queries, views, triggers, etc.
Process Skills:
Must know end-to-end data engineering pipeline development, capturing business requirements, ensuring data quality, and ongoing maintenance of pipelines.
Behavioral Skills:
Good communication skills in English; Collaborative team player; Self-starter; Excellent documentation and presentation skills; Continuous learner and advocate for Databricks usage; Experience working in an Agile Team (GitHub, Jira, MS Teams is used).
Certification: Any relevant AWS and/or Databricks certifications