Data Engineer II
Role details
Job location
Tech stack
Job description
We are seeking a Data Engineer II to join our Global Data Platform & Engineering team. In this role, you will help build and maintain scalable, cloud-native data solutions that power enterprise analytics, reporting, and emerging AI initiatives.
You will work with modern data technologies including Databricks, Apache Spark, Delta Lake, Python, SQL, and AWS to develop reliable data pipelines and curated datasets. Working closely with business stakeholders, analytics teams, and fellow engineers, you'll transform business requirements into high-quality, production-ready data solutions.
This position is ideal for an engineer who enjoys solving complex data challenges, building scalable solutions, and continuously learning new technologies., * Design, develop, and maintain scalable ELT/ETL pipelines using Databricks, Apache Spark, SQL, and Python.
- Build and maintain reliable, high-quality datasets that support enterprise analytics, operational reporting, and AI use cases.
- Develop data transformations using Delta Lake and Lakehouse architecture best practices.
- Integrate data from enterprise applications, APIs, databases, files, and other internal and external sources.
- Collaborate with business stakeholders, analysts, and product teams to understand data requirements and deliver scalable solutions.
- Monitor, troubleshoot, and optimize production data pipelines for reliability, scalability, and performance.
- Participate in migrating and modernizing legacy data processes to cloud-native architectures.
- Improve data quality through validation, testing, monitoring, and automation.
- Contribute to engineering best practices through code reviews, documentation, and knowledge sharing.
- Support continuous improvement of the enterprise data platform by identifying opportunities for automation, optimization, and simplification.
Requirements
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience.
- 3+ years of experience in Data Engineering or a related technical role.
- Strong SQL development skills.
- Strong Python programming experience.
- Experience building data pipelines using Apache Spark and Databricks (or similar distributed data processing platforms).
- Experience developing modern ETL/ELT pipelines.
- Understanding of data modeling and data warehousing concepts.
- Experience working with cloud-based data platforms, preferably AWS.
- Familiarity with Delta Lake or similar modern data storage technologies.
- Experience using Git and collaborative software development practices.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and collaboration skills.
Preferred Qualifications
- Experience with AWS data services such as Amazon S3, Lambda, or related technologies.
- Experience working with Databricks on AWS.
- Experience with Delta Lake and Medallion/Lakehouse architecture.
- Experience with orchestration tools such as Databricks Workflows, Apache Airflow, or similar workflow orchestration platforms.
- Experience consuming and developing REST APIs.
- Experience working with semi-structured data, including JSON and Excel-based data ingestion.
- Familiarity with CI/CD practices for data engineering.
- Exposure to AI/ML workflows or data preparation for machine learning and generative AI applications.
- Experience working in gaming, hospitality, financial services, or other data-intensive industries.
Technical Environment
You'll work with technologies including:
- Databricks (AWS)
- Apache Spark
- Delta Lake
- Python
- SQL
- Amazon S3
- Git
- REST APIs
- CI/CD pipelines, * You enjoy solving complex technical problems and continuously improving existing solutions.
- You can work independently while collaborating effectively with cross-functional teams.
- You write clean, maintainable, and well-tested code.
- You take ownership of your work from development through production support.
- You have a growth mindset and enjoy learning new technologies.
- You communicate technical concepts clearly with both technical and non-technical audiences.
Benefits & conditions
At IGT, we consider a wide range of factors in determining compensation, including skills, experience, education, and geographic location. These factors may result in variation in starting pay. The estimated compensation for this role is up to $104,000 USD, based on a good-faith assessment at the time of posting. Actual compensation may vary. IGT complies with all applicable pay transparency and compensation laws and collective bargaining agreements, where applicable.
Base pay is one component of IGT's total rewards program. Depending on the role, employees may be eligible for bonus or commission opportunities. IGT also offers a comprehensive benefits package, which may include a 401(k) savings plan with company contributions, medical, dental, and vision insurance, life and disability coverage, paid time off, tuition reimbursement, and other wellness programs, subject to eligibility requirements.