Data Engineer - Framework Developer
Today Experts GmbH
3 days ago
Role details
Contract type
Temporary to permanent Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English, German Experience level
SeniorJob location
Remote
Tech stack
Agile Methodologies
Azure
Information Engineering
Data Vault Modeling
DevOps
Github
Python
Scrum
SQL Databases
Data Streaming
PySpark
Splunk
Data Pipelines
Databricks
Job description
- Design and develop scalable data frameworks using Databricks
- Implement robust data pipelines using Python / PySpark
- Develop and optimize complex SQL-based transformations
- Set up and maintain CI/CD pipelines (GitHub Actions)
- Collaborate in an agile Scrum team environment
- Ensure high-quality, secure, and maintainable code
- Contribute to best practices in data engineering and DevOps
Requirements
- Senior / Advanced level experience in Data Engineering
- Strong hands-on experience with Databricks
- Solid knowledge of Python and PySpark
- Very good SQL skills
- Experience with GitHub and CI/CD pipelines (GitHub Actions)
- Experience working in Scrum / Agile environments
- English language proficiency
Nice to have
- Microsoft Azure
- Data Vault modeling
- Streaming technologies
- Unity Catalog
- Splunk
- German language skills
About the company
Mitarbeiterentwicklung & Vielfalt bei unseren Talenten als hohes Ziel. Fortschrittlich in Mitarbeiterzufriedenheit durch individuelle Goodies wie Dienstauto, Home-Office oder Weiterbildung.
Vernetzt mit hochqualifizierten IT-Fachkräften aus unterschiedlichen Bereichen, Zusammenstellung eines optimalen Teams, individueller Kundensupport - Keine Wartezeit, unbürokratisch, so lange wie gewünscht.
