Data Engineer

FREENOW
Hamburg, Germany
9 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Hamburg, Germany

Tech stack

Microsoft Word
API
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Databases
Information Engineering
Data Governance
Data Systems
Data Warehousing
Distributed Systems
Hive
Python
Machine Learning
SQL Databases
Spark
Build Management
Kafka
Spark Streaming
Functional Programming
Stream Processing
Data Pipelines
Databricks
Programming Languages

Job description

Are you passionate about data engineering and ready to revolutionize how data is managed and utilized within an organization? We are looking for a skilled and innovative Data Engineer to join our dynamic team and help us implement a cutting-edge Data Mesh architecture.

At FREENOW we believe in data driven decisions that drive our business forward. We are currently transitioning into a data mesh architecture to establish a very close collaboration between data engineers, data analysts, data scientists and machine learning engineers.

Are you ready for your next ride?

YOUR DAILY ADVENTURES WILL INCLUDE:

  • Collaborate with cross-functional teams including data analysts, data scientists, and software engineers to understand data requirements and design optimal data solutions in the Data Mesh environment.
  • Develop, implement, and maintain scalable data products that enable the seamless flow of data from various sources to the Data Mesh architecture.
  • Create and manage data models that cater to the specific needs of data consumers while adhering to data governance and security standards.
  • Design and build data quality monitoring frameworks to ensure data accuracy, consistency, and reliability.
  • Stay updated with the latest industry trends and best practices in Data Engineering and Data Mesh to continuously improve data pipelines and processes.
  • Build high-performance APIs to access and query data from data warehouse.
  • Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
  • Coordinate and oversee the successful delivery of complex data engineering projects, ensuring alignment with timelines, objectives and stakeholders.

Requirements

Do you have experience in Spark?, Be ready to work in a multinational, diverse, highly motivated and collaborative team of passionate developers who strive for excellence and like to have fun., * You have advanced knowledge of at least one programming language and are happy to learn more. Our core languages are Scala and Python.

  • Expert level of SQL (especially SparkSQL) and Datawarehouse concept, Database. Experience in building data pipelines is a core requirement. Love getting your hands dirty with the data implementing custom ETLs to craft it into information
  • You have knowledge of distributed system, Lambda, AWS S3, AWS Cloud watch ...
  • Experience with AWS, Hive, Spark, Trino, Databricks is helpful.
  • Enjoy working with stream processing frameworks like Spark structured streaming, Kafka streams.
  • You understand requirements beyond the written word. Whether you're working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by many customers, your attention to detail leads to a delightful user experience.
  • Fluent proficiency in Business English.
  • Exceptional analytical skills, lateral thinking and experience in solving challenging problems. Experiences in working with Data Visualisation tools (e.g. Tableauo, Metabase) is a plus.

Apply for this position