Data Engineer
Postaladdress
Municipality of Valencia, Spain
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
€ 80KJob location
Municipality of Valencia, Spain
Tech stack
Microsoft Active Directory
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Big Data
System Configuration
Data Infrastructure
Data Security
Distributed Systems
Hadoop
Hive
Python
Kerberos (Protocol)
Lightweight Directory Access Protocols (LDAP)
OAuth
Openshift
Performance Tuning
Ansible
Systems Integration
Google Cloud Platform
System Availability
Spark
Kubernetes
Information Technology
Data Lakehouse
Job description
I am working with a leading technology services organisation to find an experienced Senior Data Engineer to join their AI & Data team. You'll take ownership of enterprise data infrastructure, ensuring clients can seamlessly access and utilise their data across multiple platforms., * Deploying, configuring and managing Trino/Starburst Enterprise and Galaxy environments, including upgrades and performance tuning
- Administering a Dell Data Lakehouse platform, setup, maintenance, and ensuring high availability
- Integrating diverse data sources into a unified, accessible data platform
- Designing and tuning containerised solutions (Kubernetes/OpenShift) for scalability and resilience
- Setting up and managing data catalogs across multiple operational modes
- Implementing security controls, managing data access governance, and ensuring regulatory compliance
Requirements
- A degree in Computer Science, Data Science, Engineering or a related field or equivalent practical experience
- Proven Trino/Starburst Enterprise/Galaxy administration experience
- Strong Unix/Linux skills and solid understanding of distributed systems
- Kubernetes or OpenShift container orchestration experience
- Familiarity with Big Data (Hadoop/Hive/Spark) and cloud platforms (AWS, Azure, GCP)
- Knowledge of security frameworks: LDAP, Active Directory, OAuth2, Kerberos, * Starburst Certified Practitioner certification
- Python and/or Java experience
- Ansible or similar automation tooling
- Dell Data Lakehouse administration experience