Data Engineer for Databricks Platform (all humans)

Erste Group Bank AG
Wien, Austria
12 days ago
Apply on iventajobdata.eu
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
€52,136.0
Working hours
Regular working hours
Languages
English, German

Tech stack

Amazon Web Services Microsoft Azure Cloud Computing Code Review Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Systems Apache Hive DataOps Software Construction
+12 more
SQL Databases Workflow Management Systems Data Ingestion Git Data Lakes Pyspark Infrastructure Automation Frameworks Hashicorp Machine Learning Operations Terraform Software Version Control Databricks

Job description

  • Work hands-on with the Databricks platform, PySpark, and Delta Lake to build and optimize data solutions
  • Manage, operate, and continuously improve a centralized data ingestion framework
  • Design, build, and maintain data ingestion pipelines end-to-end
  • Troubleshoot and resolve data quality incidents in collaboration with data consumers and stakeholders
  • Develop and implement data quality frameworks and monitoring solutions
  • Expand platform capabilities by evaluating, testing, and adopting new Databricks features
  • Contribute to infrastructure-as-code practices and CI/CD pipeline improvements
  • Mentor junior team members and support knowledge sharing within the team

Requirements

  • 2-5 years of experience in the recent years in data engineering or a similar role
  • Recent active and direct work experience with SQL and Python for data processing, transformation, and analysis & with Databricks and/or PySpark (Delta Lake, Spark SQL, structured streaming)
  • Good understanding and expertise in data ingestion patterns, ETL/ELT processes, and data modeling fundamentals
  • Experience with software engineering best practices: version control (Git), code reviews, CI/CD pipelines
  • Familiarity with cloud platforms, preferably AWS and/or MS Azure
  • Strong analytical and problem-solving skills
  • Clear verbal and written communication; ability to interact with both technical and business stakeholders
  • Systematic, collaborative approach with a continuous learning mindset
  • Solid documentation practices
  • Not mandatory but beneficial: experience with HashiCorp Terraform, DataOps/MLOps practices, Unity Catalog, workflow orchestration tools
  • Language skills: English professional proficiency; German (e.g. B2) is a plus

About the company

Make a difference in the financial life of millions of people: At Erste Digital you are co-creating the digital future, in which better financial health is possible. #believeinyourself

We are part of Erste Group - the largest banking group in Central and Eastern Europe with more than 2,500 branches and over 45,000 employees. Our more than 2,000 IT experts and enthusiasts are the bank’s Digital Muscle., * Possibility to benefit and learn from our international, talented and passionate community at Erste

  • Interest groups and clubs: Take part in discussions and get involved in projects. Numerous interest groups invite you to engage with a topic
  • Health Centre - The Erste Campus operates a fully equipped health center that offers all employees a high standard of medical services during working hours.
  • Employee benefits - Benefit from special conditions for financial services and insurances, supermarkets, clothing stores and many more.
  • Employee Referral Program - Become a talent scout for career opportunities in IT. We are rewarding every successful referral for Erste Digital
  • A competitive and performance-related salary dependent on your professional and personal qualifications is granted - the minimum wage for this position in accordance with the respective collective agreement is EUR 52.136,- gross per year. But this is just a formality, we are more than happy to discuss your actual expectations., Erste Group considers the diversity of its employees as key to innovation and success. As employer we are proud to offer everyone equal chances, irrespective of age, skin colour, religious belief, gender, sexual orientation or origin.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on iventajobdata.eu
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

4:13 min

Speaker background and Eurowings digital transformation context

Johannes Hansen · World Congress 2023

Videos

See all

Related articles

See all