Data Engineer

You help run our data platform: getting data in, validating, cleaning and transforming it into clean tables, and making it available to the rest of the company. You also help us use AI in this work.

• Collect structured and unstructured data with Python scrapers and API connectors.
• Handle the first steps of our ELT process: validation, normalization, schema mapping, and entity mapping (matching the same company, product, or source across different datasets), so other teams get clean, reliable tables.
• Write and improve SQL that turns raw data into clean staging and processed tables. This is a mix of Python and SQL work, moving between the two as needed. You also write stored procedures, and follow best practices for schema design, indexing, and storage.
• Be the primary developer of one or more dataflows end-to-end, from ingestion all the way to the API that exposes the data to other teams and systems.
• Debug and fix problems fast, using logs, metrics, and alerts.
• Review code, write tests, and keep the codebase clean. Improve each part of the system you touch.
• Use AI tools daily to help you code (for example Claude Code). Connect your data to the AI agents our AI team builds in Microsoft Foundry, by exposing clean, well-structured data and APIs they can use.

Projects in your first year

• Add new types of data as the business grows, for example patent data or financial data.
• Improve our tools for matching public data to our own records.
• Help the business with data quality, such as fix mappings, updating records, or making manual changes when needed.

Ongoing work

• Build and maintain Python ingestion jobs and SQL-based ELT pipelines, moving between the two as the work needs. Keep the pipelines simple, modular, and easy to monitor.
• Development and maintenance of our CI/CD pipelines and follow the internal workflow
• Monitor data pipelines in Azure and via Power BI.
• Help keep the data platform reliable, scalable, and secure.
• Follow and expand on good practices for design, testing, and documentation.
• Build and maintain the Azure infrastructure needed for data ingestion and transformation.
• Use AI tools where they help, from coding assistants to connecting our data to the agents our AI team builds.

Tools you’ll use every day

• Python (including Pandas, Selenium, and our internal libraries)
• SQL (SQL Server Management Studio)
• API integration (REST, GraphQL)
• Azure DevOps (CI/CD pipelines)
• Git
• Docker and Azure Container Registry
• Azure Function App and Azure Durable Function
• Azure Logic App
• AI coding tools, such as Claude Code

Tools you’ll also use

• Microsoft Foundry (formerly Azure AI Foundry)
• Azure App Services
• Fabric
• Spark including PySpark
• Azure Storage (Blob, Table, Queue)
• Azure Monitor / Application Insights

• 2 to 4 years of experience as a data engineer, with experience in both Python and SQL.
• Experience developing and maintaining code that runs in production.
• Good SQL skills: you can write and optimize queries against a relational database, ideally SQL Server.
• Experience with Azure (or other cloud infrastructure).
• Experienced in using Git and Git workflow
• A good understanding of clean code, common design patterns, and debugging.
• Comfortable working with data: data quality rules, different formats, transformations, and matching records between sources.
• Experienced with development in popular IDE tooling’s, preferably VS Code
• Interested in using AI tools to work faster, not only in building AI features.

• Salary range (depending on experience): €54.000 - €59.500 gross per year on a basis of a 40-hour work week.
• Competitive compensation package, including a 8% holiday allowance and a performance bonus of up to 10% of gross salary.
• A senior, client-facing role with real ownership and room to grow with the company.
• Pension, bonus program, and a budget for internal and external training on the path you choose.
• A team that works and celebrates together: dinners, BBQs, boat trips and padel.

Valona Intelligence, a Leader in the 2026 Gartner Magic Quadrant and Forrester Wave for Competitive and Market Intelligence solutions, combines the deepest validated market and competitive intelligence sources with CMI expertise and accountable AI - giving business leaders a clear understanding of what is happening in their markets, and what it means for their next move. Valona has served global enterprises since 1999.

Valona Intelligence - Amsterdam

We are a team of 4 engineers, mostly based in Amsterdam, with people from many different countries. Most of us are medior or senior, so you will have experienced colleagues to learn from. Within Valona the team is part of a large Tech unit with engineers working across the globe. We value initiative, both inside the team and with the rest of the business. For example, if you see a way to make a dataflow more useful for the business, we expect you to bring that idea forward yourself, not wait to be asked.

As you grow into the role, you will take on more complex dataflows and more responsibility. There is no fixed ladder, but on a small team your growth is visible, and you talk about it directly with your manager., Valona is a recognized leader in Market & Competitive Intelligence platforms and services segment. Valona serves leading global enterprises in Europe and North America. Valona’s offering is recognized by Gartner and Forrester as market-leading and the company has invested significantly in AI capabilities, essential in a fast-changing market.

At Valona, our vision is Turning knowledge into a decisive advantage. We believe in pushing one another to learn, grow, and step outside of our comfort zones. We have a supportive environment that fosters personal and professional development. You get to work with skilled and curious colleagues, and be part of a growing AI company.

Valona has operations in multiple locations in Europe and offices in North America, and we employ 25 different nationalities in our team.