Big Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
We are seeking an experienced Big Data Engineer with a strong Java development background to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate will have hands-on experience with Java, Apache Spark, SQL, Kafka/MSK, AWS or Eligible to workP, and modern data lake technologies such as Apache Iceberg.
The candidate will work closely with data scientists and engineering teams to build reliable batch and real-time data pipelines, ensure data quality, and Eligible to workimize data processing performance.
Requirements
5 years of backend development experience focused on data engineering.
Strong programming skills in Java.
Hands-on experience with Apache Spark and DataFrames.
Advanced SQL skills and relational database experience.
ETL/ELT pipeline development and Eligible to workimization.
Experience with AWS or Eligible to workP cloud platforms.
Kafka or Amazon MSK for real-time data streaming.
Amazon S3 or similar object storage.
Apache Iceberg or equivalent data lake technologies.
Understanding of data warehousing concepts.
Strong troubleshooting, communication, and collaboration skills.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦