PySpark/Databricks Developer

APG
Heerlen, Netherlands
22 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Heerlen, Netherlands

Tech stack

Azure
Continuous Integration
Data Systems
DevOps
Web Development
Python
Scrum
SQL Databases
Data Streaming
PySpark
Information Technology
Software Version Control
Data Pipelines
Databricks
Programming Languages

Job description

On behalf of the Asset Management Responsible Investments team at APG, we are looking for a PySpark/Databricks Developer to join our team. In this role, your focus will be on developing data pipelines for newly developed Investment and Research Platforms as well as streamlining data flows for existing platforms. What you would do

  • Develop and maintain PySpark-based data pipelines in Databricks.
  • Manage Databricks workspaces, dependencies, and integrations.
  • Translate business requirements into scalable data solutions.
  • Collaborate with analytics teams to enhance data models for BI tools.
  • Maintain Azure DevOps repositories for version control and CI/CD.
  • Document solutions and share knowledge within the team.
  • Engage with stakeholders including front office, IT, and architecture teams. Our team is a multi-disciplinary team responsible for the entire delivery of a solution. The CMI-RI team comprised of international team members that collectively have the skills to get the job done every iteration. We work towards flexible and high-performing agile teams which are composed of members with T-shaped skills. What you bring

Requirements

As a PySpark/Databricks developer, you are a specialist in finding data-driven solutions. You think in terms of opportunities and are service minded. Taking ownership and accepting responsibility comes naturally to you; you have a pragmatic attitude and are motivated to deliver quality. You have a willingness to develop or enhance your t-shaped skills. Additionally we ask for:

  • Strong expertise in PySpark, Databricks, and Python (OO principles).

  • Experience with Azure Data Platform and DevOps practices.

  • Solid background in data modeling and querying (5+ years).

  • Background/degree in Computer Science / Engineering.

  • Highly developed communication skills in English.

  • Must be self-motivated, well organized, team player. Nice to haves:

  • Familiarity with financial datasets and investment data flows.

  • Experience with other modern programming languages.

  • SQL database setup and optimization.

  • Exposure to web development.

  • Agile/Scrum experience.

  • Mentoring or coaching junior developers.

Benefits & conditions

We will offer you, depending on relevant knowledge and experience, a competitive salary (fullttime 40 hours) and great employment conditions aimed at flexibility, such as:

  • A guaranteed end of year bonus of 8.33%
  • Attention to your vitality and personal development
  • Possibility to work from home 2-3 days per week
  • And obviously a well-managed pension Where you will work For pension provider APG, pension is about people, life, and living together. With careful asset management, pension administration, communication and advice, we work on a livable future for current and future generations. One in which we share prosperity and well-being fairly and sustainably. Now and later. APG is committed to around 4.5 million people in the Netherlands, which is why we believe it is important to be a reflection of Dutch society. This means that APG strives for an inclusive work environment, in which everyone can be themselves and where your unique qualities are embraced.

Apply for this position