Big Data Engineer
Role details
Job location
Tech stack
Job description
As part of GiG's growth strategy, we are establishing a dedicated Migrations Team to lead the migration of brands from legacy systems and other platforms into our modern GiG CoreX platform. In the role of Migration Engineer, you will take ownership of the technical execution of these migrations: designing, implementing, validating, and executing complex data pipelines to transfer and transform customer and operational data. You will maintain high standards of data integrity, perform rigorous testing and verification, provide support throughout cutover phases, and partner closely with stakeholders (product, infrastructure, operations, compliance) to ensure successful onboarding of clients onto CoreX., * Data Pipeline Design & Implementation: Design, develop, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of large volumes of structured and unstructured data, ensuring scalability and efficiency.
-
Migration Execution & Validation: Lead the execution of data migrations, including data extraction, transformation, schema mapping, validation, and cutover, ensuring data integrity and consistency.
-
Collaboration & Stakeholder Engagement: Work closely with product, technology, delivery, and compliance teams to gather migration requirements, align on data definitions, and ensure successful migration outcomes.
-
Automation & Optimization: Implement automation solutions for ETL/migration processes to improve efficiency and reduce manual intervention.
-
Monitoring & Troubleshooting: Monitor and troubleshoot migration pipelines, addressing issues promptly to ensure smooth operations.
-
Documentation & Process Improvement: Document migration processes, contribute to process improvement initiatives, and ensure adherence to best practices.
-
Technical Support & Incident Resolution: Provide technical support during incident resolution related to migration pipelines and data discrepancies.
-
Agile Participation: Actively participate in all agile scrum meetings such as daily standups, refinement sessions, and retrospectives.
-
Innovation & Continuous Improvement: Propose and implement new ideas to improve existing products and services, fostering a culture of innovation.
-
Code Review & Mentorship: Perform code reviews for other engineers, ensuring code quality and knowledge sharing within the team.
-
Stakeholder Communication: Effectively communicate with respective stakeholders, ensuring that all information is transmitted correctly and to the right audience.
Requirements
Do you have experience in Scrum?, Do you have a Master's degree?, Essential Skills
- Bachelor's/Master's in Computer Science, Engineering, or related field.
- 3+ years of experience in data engineering, ETL processes, or data migration.
- Strong SQL skills and experience working with structured and unstructured datasets.
- Knowledge of data governance, compliance, and data quality assurance.
- Solution-oriented mindset with the ability to troubleshoot and resolve issues.
- Strong experience with Big Data and streaming technologies including ClickHouse, Kafka and NiFi
- Strong knowledge of Microservices, APIs, GraphQL
Preferred Skills
- Experience in the iGaming industry or regulated markets.
- Experience with automation of ETL/migration processes.
Benefits & conditions
- Great career development opportunities
- Hybrid working model
- International Health Insurance
- Health and Wellbeing Package (350 EUR per year)
- Birthday Day Off
- Me Time - 1 day off per year
About Gaming Innovation Group We are an award-winning iGaming platform and sportsbook provider supplying industry-leading solutions to our partners and their players. We specialise in helping online and land-based operators expand their iGaming and sports betting business on a global scale, focusing on innovation and customisation to power localised customer experiences and intimate user journeys. As a regulated markets specialist, we offer compliant entry into 36+ complex regulated markets around the world.
Our powerful iGaming platform is built to be scalable, open and user-centric, rapidly integrating with our partners' existing tech and preferred third parties. It provides a personalised user experience through our suite of real-time marketing tools, real-time data, and real-time rules engine, allowing our partners to build their own automated bespoke rules, without the need for coding knowledge.
Our sportsbook is built mobile-first and provides a premium player experience through our Bet builder, comprehensive Live betting capabilities and Player props. Our partners benefit from tailored odds, personalised margins, and risk management strategy, increasing the players' personalised experience. Our partners benefit from an in-house trading team available 24/7 through direct communication channels, delivering unparalleled agility and service to all our partners, around the clock.
Our Hiring Process