Senior Data Engineer, AI/ML Platform
Roamler
Amsterdam, Netherlands
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Amsterdam, Netherlands
Tech stack
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Automation of Tests
Code Review
Data Validation
Web Scraping
ETL
Identity and Access Management
Python
Operational Databases
Cloud Services
Azure
Software Engineering
SQL Databases
Systems Integration
Large Language Models
Prompt Engineering
Spark
Build Management
Information Technology
Playwright
Virtual Agents
Amazon Web Services (AWS)
Terraform
Data Pipelines
Job description
- Own and evolve our data ingestion pipelines and our web scraping engine as production systems: architecture, reliability, scalability, and performance, not just individual scripts.
- Design and build AI agent based extraction workflows (for example browser automation agents that navigate outlet websites, menus, and listing platforms) where they outperform traditional scraping and parsing approaches.
- Build evaluation frameworks and quality checks so AI-driven extraction and enrichment can be trusted at the same bar as our existing rule-based systems.
- Utilize AWS & Azure services effectively across both the traditional pipeline (Airflow, Spark, Glue) and the AI-driven components (model hosting, agent orchestration).
- Enhance our automated testing, data validation, and monitoring capabilities, including for AI components, which introduce new failure modes and cost profiles compared to deterministic scraping and rule-based logic.
- Collaborate with business and data stakeholders, including our data science team, to align requirements and expectations across the full pipeline.
- Drive engineering projects end to end and ensure successful outcomes.
- Drive continuous improvement in our engineering setup.
- Foster a collaborative and enjoyable team environment through code reviews, knowledge sharing, and daily interactions.
Requirements
- Bachelor's and/or Master's degree in computer science or a related field.
- 5+ years of experience as a Data Engineer with strong software engineering skills, including ownership of production data pipelines and/or web scraping and crawling systems.
- Design, build, and operate scalable data pipelines on AWS that bring in data from external web sources and turn it into clean, queryable datasets with Playwright and/or BeautifulSoup.
- Experience with Airflow, Python, SQL, and Spark.
- Hands-on, practical experience integrating LLMs into production systems: prompt design as part of system design, evaluation, and cost/latency tradeoffs, not just experimenting in a notebook.
- Experience with AI agent frameworks (for example browser automation agents) or a strong interest in and aptitude for learning them.
- Manage infrastructure as code with Terraform on AWS (ECS, EMR, Glue, S3, SQS/SNS, IAM)
- Develop and maintain Spark jobs on EMR for batch ETL and enrichment at scale.
- Some exposure to classical ML/NLP concepts (classification, embeddings, matching) is a plus, since our data science team's pipeline uses these heavily.
- Result-driven and hands-on attitude.
- Proactive and courage to speak up.
- Ability to communicate in English, verbally and in writing.
Benefits & conditions
Pulled from the full job description
- Pension plan
- Flexible schedule, * A competitive salary & pension plan.
- Enjoy 25 days of paid holiday per year and 8% holiday allowance.
- NS-Business card for an easy commute to our awesome NDSM-Werf office.
- A working-from-home allowance of €250 for a top-notch home office.
- A company laptop for enhanced productivity.
- Flexible work hours for a balanced lifestyle, with 2 days a week at our Amsterdam office.
- Possibly some great fun at our Friday drinks and team activities.
About the company
Roamler is a Dutch technology company that helps clients grow their business, improve end-customer experience, and reduce and flexibilise the cost of field operations. It combines actionable insights with the execution capabilities required to turn those insights into measurable results. Roamler operates through two business units:
* Roamler Retail provides in-store and out-of-home insights and execution for FMCG brands and retailers across Europe, enabling clients to increase sales volumes while optimising operational efficiency.
* Roamler Tech delivers installation, maintenance, and repair services for large B2C service providers, improving customer experience while increasing the efficiency and flexibility of field execution.
With approximately 130 employees and a large network of flexible workers active across multiple European markets, Roamler supports clients including P&G, Friesland Campina, Unilever, and Eneco.
Founded in Amsterdam in 2011, Roamler is backed by Endeit Capital and Smartfin, and operates across the Netherlands, Belgium, Germany, the United Kingdom, France, and Spain.