Data Engineer Senior - Pyspark/Databricks

RM IT Professional Resources AG
Wädenswil, Switzerland
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Wädenswil, Switzerland

Tech stack

Java
Azure
C Sharp (Programming Language)
Information Engineering
Relational Databases
Software Design Patterns
Python
Software Engineering
Software Systems
SQL Databases
Spark
PySpark
Information Technology
Data Pipelines
Databricks
Programming Languages

Job description

  • Implementation of production ready data pipelines using PySpark running on Databricks based on specification provided by business analysts
  • Interaction with other data engineers and solution architects to meet functional and non-functional requirements
  • Acting as a Data Engineer, working on a major transformation project

Requirements

  • Strong software engineering skills, including familiarity and application of design patterns, and engineering best practices.
  • Proven experience developing complex software systems as a software engineer (at least 5 years)
  • Strong understanding of data engineering techniques with high level programming languages (eg, Java, C#, or Python) and analytical frameworks and Azure fundamentals
  • At least 3 years for hands on experience with Apache Spark (PySpark), developing applications using an IDE such as VS Code or PyCharm
  • Experience of working with delta lakes and optimizing Spark workloads running on it paired with strong core Python software engineering experience
  • Have a good understanding and significant experience with projects using relational data models and SQL.
  • Bachelor's or master's degree in computer science, or any other related field
  • Language skills: English

Your soft skills:

  • Excellent comprehension skills with attention to detail
  • A high degree of self-organisation and time management
  • Analytical and solution-orientated thinking

Apply for this position