Senior Data Engineer (with Java experience)
Role details
Job location
Tech stack
Job description
-
Collaborate with business stakeholders and technical teams to understand and analyze data requirements.
-
Lead the design and implementation of data models and database structures that meet business needs.
-
Profile, refactor, and tune performance in the database.
-
Design and implement complex ETL processes to extract, transform, and load data from various source systems into the data warehouse.
-
Ensure data integrity, consistency, and accuracy through robust data quality assurance measures.
-
Review and support team members, providing guidance and mentorship.
-
Supervise and contribute to the data-driven strategy for the project, aligning it with business objectives.
Requirements
-
5+ years of hands-on experience in data engineering with Java programming language and SQL.
-
Experince with Spark - minimum 5 years
-
Strong experience with ETL / ELT / orchestration tools (e.g., Airflow).
-
Drive the design and implementation of data warehouse and data lakes.
-
Proficient in code versioning (git) and building CI/CD for data projects.
-
Experience with requirement gathering and documentation.
Will be a Plus:
-
Experience with NoSQL.
-
Experience with Flink.
-
Experience with CDP, Python Kafka.