Engineer II - Big Data/ Data Warehousing - GCP Data Transformation
Computer Task Group, Inc
Phoenix, United States of America
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
Phoenix, United States of America
Tech stack
Big Data
Google BigQuery
Cloud Storage
Information Systems
Continuous Integration
Data as a Services
Information Engineering
Data Governance
ETL
Data Transformation
Data Systems
Data Warehousing
DevOps
Performance Tuning
Query Optimization
SQL Databases
Data Processing
PySpark
Information Technology
Software Version Control
Data Pipelines
Job description
- Design, develop, and implement scalable data transformation pipelines on GCP (LUMI platform).
- Perform hands-on data engineering tasks including ingestion, transformation, validation, and backfill processing.
- Develop and optimize complex SQL queries and PySpark jobs for large-scale data processing.
- Build and maintain data models supporting analytics, reporting, and downstream applications.
- Ensure data quality, integrity, and consistency across enterprise data warehouse environments.
- Collaborate with cross-functional teams including architects, analysts, and application developers to deliver data solutions.
- Troubleshoot and resolve data pipeline and performance issues in a cloud-native environment.
- Adhere to best practices in data governance, security, and DevOps within GCP.
Requirements
- Strong hands-on experience with Data Transformation on GCP (LUMI).
- Extensive knowledge of data modeling concepts (dimensional, normalized, and hybrid models).
- Advanced SQL development skills, including performance tuning and query optimization.
- Strong PySpark development experience for large-scale data processing.
- Experience with ETL/ELT frameworks in Big Data and Data Warehousing environments.
- Understanding of data backfill strategies and historical data processing.
- Familiarity with GCP data services (e.g., BigQuery, Cloud Storage, Dataproc) preferred.
- Knowledge of CI/CD practices and version control systems is a plus.
Experience:
- 3-5+ years of experience in Big Data/Data Warehousing environments.
- Proven experience developing and supporting enterprise-grade data pipelines.
- Demonstrated hands-on expertise in GCP-based data engineering and transformation initiatives.
Education:
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field (or equivalent work experience).
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
About the company
CTG, a Cegeka company, is at the forefront of digital transformation, providing IT and business solutions that accelerate project momentum and deliver desired value. Over nearly 60 years, we have earned a reputation as a faster and more reliable, results-driven partner. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. CTG leverages the expertise of over 9,000 team members in 19 countries to provide innovative solutions. Together, we operate across the Americas, Europe, and India, working in close cooperation with over 3,000 clients in many of today's highest-growth industries. For more information, visit www.ctg.com
Our culture is a direct result of the people who work at CTG, the values we hold, and the actions we take. In other words, our people define our culture. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. Part of our mission is to cultivate a workplace that attracts and develops the best people.
CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws.
CTG is an Equal Opportunity Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. CTG is fully committed to promoting employment opportunities for members of protected classes.