Data Engineer Senior

The main activities are:

• Develop within the data framework
• Write technical specifications
• Write Unit Test
• Participating to architecture direction
• Provide and Put in place the best practise around data management
• Ensure deliveries and respect deadlines
• Production Monitoring / Maintenance

• The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.
• Expected technical skills
• Technical skills required: (by order of priority for the assignment)
• Python V3
• Pyspark
• Databricks
• AWS
• Airflow (preferred)
• Azure DevOps (TFS or VSTS) (preferred)
• Terraform (preferred)
• Iomnia / Postman (preferred)
• CI / CD (preferred)
• C# (preferred)

Expected functional skills

• Solid understanding of relational databases (SQL) and data warehouses
• Experience with the Databricks platform, including creating and executing ETL tasks, managing Spark clusters, and optimizing SQL queries (preferred)
• Ability to collaborate with multidisciplinary teams and communicate effectively with stakeholders (preferred)
• Proactive problem-solving skills and the ability to work autonomously (preferred)
• Knowledge and skills in the energy market industry (preferred)
• Knowledge of portfolio management or risk management or Trading (preferred)
• Knowledge in the energy forecasting activities (preferred)
• Demonstrated ability to effectively understand customer requirements and deliver innovative solutions that those customer demands (preferred)
• Agile methodology (preferred)

Expected behavioural competencies

• Strong interpersonal skills with proven ability to interact with a wide variety of stakeholders, assimilate feedback and assess impact on your perimeter
• Comfortable with working in a fast-paced multidisciplinary environment while maintaining strict customer data privacy requirements
• Capacity to atomize and abstract topics to make them more generic
• Entrepreneurial spirit and creative approach to problem solving especially in Digital initiatives
• Uncompromising integrity and ethical standards

Expected deliverables

• Monthly Time Track
• Activity report