Data Engineer
Role details
Job location
Tech stack
Job description
Our traders, analysts and models have an unstoppable appetite for data. The Data Team is responsible for making sure that all data needs are met, and correct data is available at any time. Since there is more work than people, we are looking for a data engineer to complete our team.
What will you do:
As a Data Engineer at Priogen you will be responsible for defining, building, and maintaining data flows. This is done through the creation of code-based tools allowing the business to rely on the available data.
Data acquisition is primarily done with API, sFTP and Web-based clients, then validated and ingested. These processes will require modern development standards such as Test-Driven Development, use of microservices and consideration of data governance.
The role will involve the creation and management of CI/CD pipelines so prior experience with GIT and version management is required. Experience is also needed with the ingestion of data to and from data warehouses. Prior experience with cloud services is required, particularly AWS.
Requirements
- Experience with Python including commonly used libraries as well as testing frameworks and use of object-oriented functionality such as classes
- Experience with SQL, particularly on large datasets
- Experience with Big Data and knowledge of data management techniques
- Experience with ingestion, processing and storage of continuous data feeds
- Experience with cloud platforms, preferably AWS
- Use of Git version management such as Gitlab
- Understanding of DevOps concepts and when to apply them to data transformation
- Experience with the Bash scripting language
- Prior experience with Java is a plus but not required
- Familiarity with Agile methodology, particularly the use of Jira and Confluence, when working across several projects
- Effective communication and stakeholder management skills
Who you are:
- Bachelor's (equivalent) or higher degree in Computer/Information Science
- At least 2 years work experience in data engineering or related field
- Detail-oriented problem solver
- Solution focused
- Team player
- Fluent in English
Benefits & conditions
- Interesting and challenging work! We offer roles with broad responsibilities, high autonomy and diverse tasks.
- Performance coaching and training aimed at strong personal development and career growth.
- Excellent benefits! Pension plan, commuting allowance, fitness discount, social events and more.