Data Engineer with Scala/DB2 @ New York, NY

VBEST Software Inc
New York, United States of America
7 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

New York, United States of America

Tech stack

Databases
Data Validation
ETL
Data Visualization
IBM DB2
Python
Machine Learning
Standard Sql
Scala
Data Processing
Cloud Platform System
Data Management
Data Pipelines

Job description

Our client is looking for a Data Engineer with strong Scala and DB2 performance skills to join their team in New York, NY. The ideal candidate will be responsible for developing and maintaining data pipelines, optimizing database performance, and ensuring data quality and integrity., * Develop and maintain data pipelines using Scala

  • Optimize DB2 performance to ensure efficient data processing
  • Design and implement ETL processes to extract, transform, and load data
  • Collaborate with data scientists and analysts to understand data requirements
  • Ensure data quality and integrity by implementing data validation and quality checks
  • Troubleshoot and resolve data-related issues in a timely manner

Requirements

  • Proven experience as a Data Engineer
  • Proficiency in Python, Scala, and SQL
  • Strong knowledge of DB2 database management system
  • Experience with ETL processes and tools

Preferred Skills:

  • Experience working with data visualization tools
  • Knowledge of machine learning algorithms
  • Experience with cloud-based data platforms
  • Excellent problem-solving and analytical skills

Apply for this position