Data Engineer

As a Data Engineer at US Tiger Securities, you will support the company’s data platform and work with cross-functional teams to deliver reliable data pipelines, reports, data services, and interface applications for business users.

The ideal candidate has strong SQL and Python skills, hands-on experience with data pipelines and orchestration, and the ability to debug data issues across database, streaming, batch processing, and BI systems., * Build and maintain reliable batch and near-real-time data pipelines using Python, SQL, Airflow, Kafka, Flink, Spark, Hive, Doris, DataSight, or similar technologies.

• Identify recurring reporting or data service needs and implement reusable internal solutions. Experience with Python, Java, Django, and JavaScript debugging is helpful.
• Develop and maintain data interfaces for internal and external systems using RESTful APIs and message queue technologies such as Apache Kafka or IBM MQ.
• Help troubleshoot, monitor, and improve data platform components across TiDB, Kafka, Flink, Hive, Spark, Doris, DataSight, and AWS services such as EC2, Docker, RDS, Redshift, and S3.

• Bachelor’s degree in Data Engineering, Computer Science, Information Technology, or a related field.
• Minimum of 3 years of experience in a data engineering or data platform role.
• Strong SQL skills and hands-on experience with relational databases or analytical databases.
• Proficiency in Python; Java experience is a plus.
• Experience building or maintaining ETL/ELT data pipelines.
• Experience with Apache Airflow or another workflow orchestration tool.
• Ability to debug production data issues across logs, SQL queries, pipeline jobs, and application interfaces.
• Proficiency in Mandarin Chinese is required, as the role will involve collaboration with Mandarin-speaking engineering and business stakeholders.

Preferred:

• Experience with TiDB, Kafka, Flink, Hive, Spark, Doris, and DataSight, or a comparable real-time/batch data warehouse architecture.
• Experience with Kafka, CDC, streaming data processing, and IBM MQ is a big plus.
• Experience with Spark/PySpark, Flink/PyFlink, Hive, or Doris performance tuning and data modeling.
• Experience with Django, RESTful APIs, JavaScript, and web debugging tools.
• Experience with AWS and related cloud technologies, including EC2, Docker, RDS, Redshift, and S3., * Bachelor’s (Required)

• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Paid time off

Job Types: Full-time, Internship

Pay: $80,000.00 - $110,000.00 per year