Data Engineer Senior - Pyspark/Databricks
RM IT Professional Resources AG
Wädenswil, Switzerland
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Wädenswil, Switzerland
Tech stack
Java
Azure
C Sharp (Programming Language)
Information Engineering
Relational Databases
Software Design Patterns
Python
Software Engineering
Software Systems
SQL Databases
Spark
PySpark
Information Technology
Data Pipelines
Databricks
Programming Languages
Job description
- Implementation of production ready data pipelines using PySpark running on Databricks based on specification provided by business analysts
- Interaction with other data engineers and solution architects to meet functional and non-functional requirements
- Acting as a Data Engineer, working on a major transformation project
Requirements
- Strong software engineering skills, including familiarity and application of design patterns, and engineering best practices.
- Proven experience developing complex software systems as a software engineer (at least 5 years)
- Strong understanding of data engineering techniques with high level programming languages (eg, Java, C#, or Python) and analytical frameworks and Azure fundamentals
- At least 3 years for hands on experience with Apache Spark (PySpark), developing applications using an IDE such as VS Code or PyCharm
- Experience of working with delta lakes and optimizing Spark workloads running on it paired with strong core Python software engineering experience
- Have a good understanding and significant experience with projects using relational data models and SQL.
- Bachelor's or master's degree in computer science, or any other related field
- Language skills: English
Your soft skills:
- Excellent comprehension skills with attention to detail
- A high degree of self-organisation and time management
- Analytical and solution-orientated thinking