Data Engineer

Intersources Inc.

New York, NY, United States

1 day ago

Apply on www2.jobdiva.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

3 years minimum

Working hours

Regular working hours

Languages

Chinese

Job source

www2.jobdiva.com

Tech stack

JavaScript (Programming Language) Airflow Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Data Analysis Cloud Computing Databases Data as a Services Information Engineering Data Infrastructure Extract Transform Load (ETL)

+19 more

Data Systems Database Queries Software Debugging Django Web Framework IBM WebSphere MQ Python (Programming Language) Queueing Systems SQL Databases Data Processing Data Server Interface Cloud Platform System Pandas Amazon Relational Database Service Information Technology Apache Kafka Restful APIs Data Pipelines Docker Amazon Redshift

Job description

As a Data Engineer at Client, you will develop a deep understanding of the company’s diverse data landscape and collaborate closely with cross-functional teams to gather requirements and deliver data-driven solutions. You will be responsible for providing data services through reports, systems, and interface applications to support various business functions., * Data Analysis and Reporting : Work with business analysts and stakeholders to understand their data needs and deliver data solutions. Requires a strong understanding of data processing and hands-on experience with tools such as SQL, Pandas, and Jupiter.

Data Service Platform Development : Identify recurring analytical and reporting needs and implement reusable solutions within the internal data service platform. Proficiency in Python, Django, and JavaScript is required, along with strong debugging skills.
Data Processing Pipelines : Design, build, and maintain reliable and scalable daily data pipelines. Experience with Apache Airflow or other ETL orchestration tools is essential.
External Data Interfaces : Develop and maintain data services for external systems based on internal datasets. Requires knowledge of RESTful APIs and message queue technologies such as IBM MQ or Apache Kafka.
Data Platform Infrastructure : Work with cloud-based infrastructure components, including EC2, Docker, RDS, Redshift, and S3 to support the data platform.

Requirements

The ideal candidate has a strong background in data engineering, is proficient in mainstream database systems, and possesses solid development skills, including the ability to perform in-depth debugging and troubleshooting. A passion for solving complex data challenges and enabling data-driven decision-making is essential., * Bachelor’s degree in Data Engineering, Computer Science, Information Technology, or a related field