Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our data-driven decision-making processes. You will work with large datasets, ensuring data quality and accessibility while collaborating with cross-functional teams to deliver insights that drive business outcomes., * Design and implement scalable data pipelines using technologies such as Apache Hive, Hadoop, and Spark.

• Develop and maintain data warehouses to facilitate efficient data storage and retrieval.
• Collaborate with data scientists and analysts to understand their data requirements and provide necessary support.
• Vaticinate future trends in data management and analytics to enhance our data infrastructure.
• Ensure the integrity, quality, and security of data across various platforms.
• Utilise AWS services for cloud-based data storage and processing solutions.
• Write complex SQL queries for data extraction, transformation, and loading (ETL) processes.
• Work with Informatica for effective data integration and workflow management.

Do you have experience in Spark?, * Proven experience as a Data Engineer or in a similar role within a big data environment.

• Proficiency in SQL and experience with relational databases.
• Familiarity with big data technologies such as Hadoop, Spark, and Apache Hive.
• Experience in designing and implementing data warehouses.
• Knowledge of cloud platforms, particularly AWS services related to data storage and processing.
• Strong analytical skills with the ability to troubleshoot issues effectively.
• Excellent communication skills to collaborate with technical and non-technical stakeholders.
• A proactive approach to problem-solving with a keen attention to detail.