Data Engineer/ETL Engineer

Gaming Innovation Group
Municipality of Marbella, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Municipality of Marbella, Spain

Tech stack

API
Agile Methodologies
Big Data
Software Quality
Code Review
Data Auditing
Information Engineering
Data Governance
Data Integrity
ETL
Data Migration
Data Mining
Database Queries
Unstructured Data
Working Model 2D
Information Technology
Kafka
Apache Nifi
GraphQL
Video Streaming
Vertica
Microservices

Requirements

of large volumes of structured and unstructured data, ensuring scalability and efficiency. Migration Execution & Validation: Lead the execution of data migrations, including data extraction, transformation, schema mapping, validation, and cutover, ensuring data integrity and consistency. Collaboration & Stakeholder Engagement: Work closely with product, technology, delivery, and compliance teams to gather migration requirements, align on data definitions, and ensure successful migration outcomes. Automation & Optimization: Implement automation solutions for ETL/migration processes to improve efficiency and reduce manual intervention. Monitoring & Troubleshooting: Monitor and troubleshoot migration pipelines, addressing issues promptly to ensure smooth operations. Documentation & Process Improvement: Document migration processes, contribute to process improvement initiatives, and ensure adherence to best practices. Technical Support & Incident Resolution: Provide technical support during incident resolution related to migration pipelines and data discrepancies. Agile Participation: Actively participate in all agile scrum meetings such as daily standups, refinement sessions, and retrospectives. Innovation & Continuous Improvement: Propose and implement new ideas to improve existing products and services, fostering a culture of innovation. Code Review & Mentorship: Perform code reviews for other engineers, ensuring code quality and knowledge sharing within the team. Stakeholder Communication: Effectively communicate with respective stakeholders, ensuring that all information is transmitted correctly and to the right audience. Requirements Essential Skills ~ Bachelor's/Master's in Computer Science, Engineering, or related field. ~3+ years of experience in data engineering, ETL processes, or data migration. ~ Strong SQL skills and experience working with structured and unstructured datasets. ~ Knowledge of data governance, compliance, and data quality assurance. ~ Solution-oriented mindset with the ability to troubleshoot and resolve issues. ~ Strong experience with Big Data and streaming technologies including ClickHouse, Kafka and NiFi ~ Strong knowledge of Microservices, APIs, GraphQL Preferred Skills Experience in the iGaming industry or regulated markets. Experience with automation of ETL/migration processes. Benefits Great career development opportunities Hybrid working model International Health Insurance Health and Wellbeing Package (350 EUR per year) Birthday Day Off Me Time - 1 day off per year J-18808-Ljbffr

Apply for this position