Sr. Data Engineer
Role details
Job location
Tech stack
Job description
We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable and high-performance data pipelines that support analytics and machine learning initiatives. The role involves close collaboration with cross-functional teams to ensure data availability, quality, and reliability across modern cloud and data platforms.
Key Responsibilities
-
Design, develop, and maintain scalable data pipelines for batch and real-time processing.
-
Build and optimize data ingestion, transformation, and processing workflows using modern data engineering frameworks.
-
Develop and maintain RESTful web services and APIs for data integration and consumption.
-
Implement and manage streaming data solutions using platforms such as Kafka.
-
Ensure data quality, consistency, reliability, and performance across multiple data systems.
-
Collaborate with analytics, data science, and engineering teams to support data-driven use cases.
-
Troubleshoot and resolve data pipeline, performance, and scalability issues.
-
Contribute to architecture decisions, coding standards, and data engineering best practices.
Requirements
-
8+ years of experience in data engineering or related roles.
-
Strong programming experience in Java and Apache Spark.
-
Hands-on experience with RESTful Web Services and API development.
-
Experience with Kafka or other streaming and messaging platforms.
-
Solid understanding of data engineering principles, including ETL/ELT and real-time processing.
-
Strong SQL skills for data validation, transformation, and analysis.
-
Experience working with cloud platforms such as AWS or Azure.
Preferred Skills
-
Experience with Snowflake or other modern cloud data warehouses.
-
Proficiency in Python