DATA ENGINEER
Role details
Job location
Tech stack
Job description
- Technical and human support for each project and effective career management
- Training to develop your professional skills
- Take part in special dedicated events
- Join a dynamic team
Responsibilities: Part of the Data Engineering team, you will play a crucial role in overseeing the maintenance and optimization of data pipelines within the Databricks platform. Your primary responsibilities will encompass addressing evolving business requirements, refining ETL processes, and ensuring the seamless flow of energy data across our systems., 1. Design, Develop, and Maintain Robust Data Workflows:
- Create and maintain scalable data workflows on Databricks integrated with AWS.
- Collaborate closely with cloud and frontend teams to unify data sources and establish a coherent data
model.
- Ensure Data Pipeline Reliability and Performance:
- Guarantee the availability, integrity, and performance of data pipelines.
- Proactively monitor workflows to maintain high data quality.
- Collaborate for Data-Driven Insights:
- Engage with cross-functional teams to identify opportunities for data-driven enhancements and insights.
- Analyze platform performance, identify bottlenecks, and recommend improvements.
- Documentation and Continuous Learning:
- Develop and maintain comprehensive technical documentation for ETL implementations.
- Stay abreast of the latest Databricks/Spark features and best practices, contributing to the continuous
improvement of our data management capabilities.
Requirements
Do you have experience in Spark?, Do you have a Bachelor's degree?, * Bachelor's degree in Computer Science, Information Technology, or a related field.
Essential skills: Technical Skills:
- Strong expertise in PySpark.
- Proficiency in SQL and scripting languages (e.g., Python).
- Excellent analytical and problem-solving skills.
- Strong communication skills in French (both written and verbal) and fluency in English.
Desired skills: Additional Preferred Skills:
- Familiarity with industry-specific regulations and compliance requirements.
- Previous experience in the energy trading domain is a nice-to-have.
- Personal Attributes:
- Ability to work effectively in a fast-paced, collaborative environment.
- Detail-oriented with effective task prioritization skills.
- Demonstrated adaptability and a keen willingness to learn new technologies and tools.
- Strong customer orientation.
Experience: Minimum of 5 years as a Data Engineer, with a proven track record of implementing pipelines inDatabricks Experience in cloud environments (AWS or Azure) is a plus. Fluent english required, advanced French is mandatory
