Big Data Engineer - Sr

Dexian DISYS

Plano, TX, United States

13 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Java (Programming Language) Agile Methodology Amazon Web Services Batch Processing Cloud Database Information Engineering Apache Hadoop Python (Programming Language) Standard Sql Workflow Management Systems Apache Spark Kubernetes

+2 more

Apache Kafka Data Pipelines

Job description

Large-scale enterprise migration initiative involving migration of existing data pipelines to a new platform while building new data features.
Resources will be split across two engineering pods-one focused on new feature development and the other on pipeline migration., * Design, build and maintain batch and real-time data pipelines
Develop new data features
Migrate existing pipelines
Work with Kafka event streaming
Spark batch processing
Orchestration frameworks
AWS cloud services
Collaborate in Agile teams
Participate in standups
Support enterprise-scale migration- data engineering initiatives.

Requirements

Python with some Java or Java with Python
SQL
AWS
Kafka, Spark,
EMR/Hadoop,
Data Pipelines, Data Orchestration, Cloud Data Warehousing, Workflow Orchestration.
Agile

About the company

Dexian stands at the forefront of Talent + Technology solutions with a presence spanning more than 70 locations worldwide and a team exceeding 10,000 professionals. As one of the largest technology and professional staffing companies and one of the largest minority-owned staffing companies in the United States, Dexian combines over 30 years of industry expertise with cutting-edge technologies to deliver comprehensive global services and support.