Data Engineer

Isite Technologies Inc

Dallas, United States of America

4 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Job location

Dallas, United States of America

Tech stack

Java

Amazon Web Services (AWS)

Continuous Integration

Data Transmissions

Data Stores

Hadoop

JSON

Python

SQL Databases

File Transfer Protocol (FTP)

Snowflake

Spark

SAP Sybase ASE

Data Lake

Avro

Kafka

Requirements

Data store Migration from on-prem , Datalake tool AWS hosted Lake house . Pipeline migration logic and Scheduling , data transfer , Translating legacy SQL and Spark for compatibility Snowflake and Iceburg , datareconciliation , Python / java , CI/CD , Kafka , FTP , Json , Avro , hadoop , sybase IQ