GCP Cloud/ Data Engineer
Role details
Job location
Tech stack
Job description
As part of COE BI strategic initiatives, we are migrating the data platform from SQL server to GCP Big Query. The consultant will work with the GCP Platform lead and will be responsible for migrating ETL jobs from SQL server, Teradata to GCP Big Query using Talend ETL .Also responsible for scheduling of various platform processes, jobs in Apache Airflow and providing support in monitoring execution of them Work with the Data Engineering and Reporting teams, analyze the SQL server stored procedures and migrate the business logic to Big Query
Requirements
Primary Experience with working with various ETL tools including SSIS, Teradata BTQ, Talend Experience with data platforms: GCP Big Query, Teradata, AWS, SQL server Experience in GCP Platform, services including Big Query, Cloud storage, IAM Experience in data set creation in Big Query and optimize them Expertise in understanding, analyzing SQL server stored procedures and packages, Python based ETL, Teradata batch scripts Knowledge in cloud database operations, tools and technologies that are required for on-prem to cloud migration. -Experience programming/scripting/coding (SQL, Python, etc.) and knowledge of relational databases.
Skills: Amazon Web Services (AWS), Analysis Skills, Apache, Business Intelligence, Cloud Computing, Consulting, Data Migration, Data Sets, Database Extract Transform and Load (ETL), GCP (Good Clinical Practices), Microsoft SQL Server, NCR Teradata, Python Programming/Scripting Language, Query Optimization, Relational Databases (RDBMS), SQL (Structured Query Language), SQL Server Integration Services (SSIS), Scripting (Scripting Languages), Software Engineering, Stored Procedures, Strategic Planning