Data Engineer
Excelloit Consultancy Services
31 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
Tech stack
Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
JIRA
Customer Data Management
Data Architecture
Information Engineering
Data Governance
Data Systems
DevOps
Github
Python
Performance Tuning
SQL Databases
YAML
Data Processing
Data Pipelines
Databricks
Job description
We are looking for an experienced Databricks SQL Data Engineer to join our growing data team in Barcelona. In this role, you will design, build, and optimize large-scale data pipelines using Databricks on AWS, driving data innovation and performance across complex enterprise environments., * Design and maintain end-to-end data engineering pipelines, ensuring reliability, scalability, and quality.
- Develop and optimize Databricks SQL notebooks, workflows/jobs, DABs, DLT, Delta/Iceberg.
- Write efficient and performant SQL queries, functions, and procedures to support analytical and operational use cases.
- Collaborate with cross-functional teams (Data Architects, Analysts, DevOps, and Infra Teams) to deliver robust data solutions on AWS (S3).
- Manage and safeguard customer data (PII, GDPR) and implement best practices in data governance.
- Support and enhance enterprise Databricks deployments, contributing to continuous improvements.
Requirements
Technical Skills:
- 5+ years in data engineering, data architecture, or data processing.
- Minimum 2-3+ years hands-on experience with Databricks SQL on AWS for large-scale data projects.
- Strong experience with Python, YAML, and SQL performance tuning.
- Familiarity with CRM / Customer360 projects is a plus.
- Practical experience in handling data governance, PII, and GDPR compliance.
Process & Tools:
- Proven ability to translate business requirements into scalable data solutions.
- Experience with GitHub, Jira, MS Teams, and working within Agile environments.
Soft Skills:
- Strong communicator with excellent documentation and presentation abilities.
- Proactive, self-driven, and collaborative team player.
- Passionate about learning and promoting Databricks best practices.
Certifications (Preferred):
- AWS and/or Databricks certifications are highly valued.