Data engineer

Descripción de la vacante Are you obsessed with the possibilities of the emerging fields of artificial intelligence? Do you believe we can design & develop our own futures? Are you proactive and passionate? We’re looking for an experienced Data Engineer (medior/senior) who has a talent for problem solving, a keen interest in technology, and wants to help deliver real world solutions. Who are we? We are the DEUS initiative , and we are all about exploring AI in the service of humanity. No, we are not calling ourselves gods(), but our name is a reference to ‘deus ex machina’ (or god from the machine in Latin). We believe that artificial intelligence technologies such as machine learning, computer vision and natural language processing will have a massive impact on the way we live, and we want to make sure that we create a positive impact on the world with these AI services. As a happy coincidence, DEUS is also an acronym representing the quadrivium of key disciplines we believe are important to building successful AI-powered services: D ata / E ngineering / U ser-experience design / S trategy. DEUS is a new initiative, but the founders have been working together very successfully for years, so there is a comfortable family feel to the company. We have an amazing set of international client partnerships (and projects/challenges). Our headquarters is located in the heart of the city centre of Amsterdam. We also have a team in Portugal that is based out of the beautiful city of Porto with an office close to the beach, and our Spanish team is based out of the charming center of A Coruña Who are you? You have a degree in Computer Science, Artificial Intelligence, with experience in Data Ops combined with in-depth knowledge of SQL/No SQL databases. You like working with large amounts of data. We are in charge of the data warehouse and pipeline, designing the architecture and centralising data, ensuring integrity across different sources and system performance. Together with the data science team we look to optimise existing processes and setup new ones. You’ll join a small but fast-growing data team (the D in DEUS), responsible for the technical aspects of various AI projects. Some examples of tasks would be setting up a data warehouse, extracting, transforming and loading data, and above all task automation. You will also collaborate closely with the other teams to conceptualise, and most of all to make things happen. You’re interested in helping us implement MLops in the NLP and Computer Visions projects we are currently working on. You have experience bringing a Proof of Concept ML model into production. You have experience with: Proficiency in SQL is essential for effective data manipulation, querying, and reporting within our data systems. Databricks as a platform,including Unity Catalog and Delta Protocol Py Spark/Spark for distributed data processing. Distributed data processingtechniques Azure data services like ADF, Synapse, and Event Hubs. Familiaritywith Microsoft Fabric is also valuable. You know or have an understanding of: Apache Airflow Snowflake Apache Flink …and some more points: Excellent written and verbal English is the only language requirement. Working experience with at least one machine learning framework (e.g., Tensor Flow, Py Torch, scikit-learn) Programming experiencewith Python Experience with databases, cloud computing, version control, best practices in data engineering and software development Knowledge of ML fundamentals, an interest in NLP and computer vision applications We will provide top hardware [macbook pro etc] and the latest software - we use the right tools for the job. note: If you don’t feel that you perfectly fit the description above, but you have some other background or skillset that you think could be of interest, please still get in touch We are dedicated to making a friendly and inclusive workplace. To