Data Engineer

Xoriant Corporation

Richmond, United States of America

5 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Compensation

$ 133K

Job location

Remote

Richmond, United States of America

Tech stack

Java

Amazon Web Services (AWS)

Bash

Big Data

Cloud Engineering

ETL

Data Transformation

Python

Scala

Shell Script

SQL Databases

Data Streaming

Data Processing

Scripting (Bash/Python/Go/Ruby)

Freeform SQL

Spark

Ab Initio

Core Api

Data Pipelines

Job description

Seeking a Senior Data Engineer to design and implement high-performance data processing applications. You will bridge the gap between traditional ETL and modern cloud-native big data ecosystems. Technical Stack: Core Development: Java, Scala, Python. Big Data: Spark (Core/SQL/Streaming), Ab Initio (ETL design & integration). Cloud: AWS (S3, EMR, Lambda, Glue). Scripting/Automation: Shell Scripting (Bash), Python., * Develop scalable data pipelines using Spark and Scala within AWS.

Integrate legacy Ab Initio workflows with modern cloud-based environments.
Automate system tasks and deployments using Shell Scripting and Python.
Optimize complex SQL queries and data transformations for maximum performance.
Collaborate with stakeholders to translate business requirements into technical specs.