Data Engineer - Data Platforms

eCom Solutions
Piscataway, NJ, United States
6 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
$141,440.0
Working hours
Regular working hours

Tech stack

Agile Methodology Data Analysis Big Data Cloudera Impala Continuous Integration Information Engineering Extract Transform Load (ETL) Database Queries Software Debugging Distributed Data Store Apache Hadoop Apache Hive
+11 more
Python (Programming Language) Natural Language Processing Open Source Technology Performance Tuning Standard Sql Software Engineering Data Processing Apache Spark Data Management Api Design Data Pipelines

Requirements

” Apache Spark & Scala Strong hands-on experience developing distributed data-processing applications. β€œ Hadoop / Hive / Impala Strong experience working with enterprise Big Data platforms and large datasets. β€œ SQL Advanced SQL skills including complex queries, joins, transformations, reconciliation, and performance tuning. β€œ Python Strong scripting and data-processing experience for automation, utilities, and data engineering activities. Preferred Skills: β€œ Experience working within banking or financial services environments. β€œ Understanding of large-volume transactional and financial datasets. β€œ Knowledge of ETL/data pipelines, data quality, and data reconciliation. β€œ Experience with Agile development and CI/CD practices. BGC

A Data Engineer with expertise in Data Platforms specializes in developing applications on Big Data technologies, such as API development. This role requires a strong foundation in traditional Application Development, along with knowledge of Analytics libraries, open-source Natural Language Processing, and statistical and big data computing libraries. The ideal candidate will possess exceptional technical abilities to understand, design, write, and debug complex code.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…