GCP Cloud/ Data Engineer

Rapinno Tech Inc
Irving, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Irving, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Apache HTTP Server
Business Logic
Google BigQuery
Cloud Computing
Cloud Database
Cloud Storage
Computer Programming
Databases
Information Engineering
Data Files
ETL
Data Migration
Relational Databases
Identity and Access Management
Python
Microsoft SQL Server
Query Optimization
Software Engineering
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Talend
Teradata
Scripting (Bash/Python/Go/Ruby)
Data Management
Cloud Migration

Job description

As part of COE BI strategic initiatives, we are migrating the data platform from SQL server to GCP Big Query. The consultant will work with the GCP Platform lead and will be responsible for migrating ETL jobs from SQL server, Teradata to GCP Big Query using Talend ETL .Also responsible for scheduling of various platform processes, jobs in Apache Airflow and providing support in monitoring execution of them Work with the Data Engineering and Reporting teams, analyze the SQL server stored procedures and migrate the business logic to Big Query

Requirements

Primary Experience with working with various ETL tools including SSIS, Teradata BTQ, Talend Experience with data platforms: GCP Big Query, Teradata, AWS, SQL server Experience in GCP Platform, services including Big Query, Cloud storage, IAM Experience in data set creation in Big Query and optimize them Expertise in understanding, analyzing SQL server stored procedures and packages, Python based ETL, Teradata batch scripts Knowledge in cloud database operations, tools and technologies that are required for on-prem to cloud migration. -Experience programming/scripting/coding (SQL, Python, etc.) and knowledge of relational databases.

Skills: Amazon Web Services (AWS), Analysis Skills, Apache, Business Intelligence, Cloud Computing, Consulting, Data Migration, Data Sets, Database Extract Transform and Load (ETL), GCP (Good Clinical Practices), Microsoft SQL Server, NCR Teradata, Python Programming/Scripting Language, Query Optimization, Relational Databases (RDBMS), SQL (Structured Query Language), SQL Server Integration Services (SSIS), Scripting (Scripting Languages), Software Engineering, Stored Procedures, Strategic Planning

Apply for this position