> Markdown version of [/jobs/ext/1937480-web-scraper](https://www.wearedevelopers.com/jobs/ext/1937480-web-scraper). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Web Scraper - **Company:** Nielseniq - **Location:** Barcelona, Spain - **Contract:** Permanent contract - **Skills:** HTML, JavaScript (Programming Language), Amazon Web Services, Microsoft Azure, Bash Shell, Code Review, Data Validation, Linux, Django Web Framework, Python (Programming Language), Regular Expressions, Software Engineering, Web Application Frameworks, Time Series Databases, Git, Fastapi, Pandas, Information Technology, Influxdb, Graphql, Restful APIs, Data Pipelines, Docker - **Published:** August 5, 2026 - **Apply:** https://www.buscojobs.com.es/web-scraper-en-barcelona-ID-366043492 ## About the Role * Master in Computer Science, IT, or related field * At least 3 years of professional software engineering experience * Knowledge of BeautifulSoup or Scrapy * Familiarity with HTML and JavaScript, understanding of SPAs * Experience with RESTful and/or GraphQL APIs * Hands-on experience with Django, FastAPI or similar Python frameworks * Scrapy knowledge is a plus * Experience with time series databases like InfluxDB is advantageous * Strong skills in Docker, Git, pandas, regex, Linux, and bash scripting * Proven experience with AWS, GCP, or Azure Requisitos principales * Flexible working environment * Volunteer time off * LinkedIn Learning * Employee-Assistance-Program (EAP) ## Description Experteer Overview In this role you will help optimize data collection as a Python Developer in our scraping team.You will design, implement, and document robust Scrapy spiders to withstand website changes while preserving existing functionality.You'll ensure high data quality through code reviews and validation, and build sophisticated crawlers that navigate anti-bot measures.You will contribute to major developments across codebases and share knowledge through documentation and training.This is a chance to shape scalable data pipelines for real-time market visibility in a fast-growing, startup-minded environment.Compensaciones / Beneficios* Design, implement and document Scrapy spiders for robust data collection* Perform code reviews and data validation to ensure quality* Develop crawlers that handle anti-bot measures using HTTP and browser techniques* Architect and contribute to new developments across multiple codebases with documentation and training* Collaborate with cross-functional teams to share knowledge and enable tooling improvementsResponsabilidades* Master in Computer Science, IT, or related field* At least 3 years of professional software engineering experience* Knowledge of BeautifulSoup or Scrapy* Familiarity with HTML and JavaScript, understanding of SPAs* Experience with RESTful and/or GraphQL APIs* Hands-on experience with Django, FastAPI or similar Python frameworks* Scrapy knowledge is a plus* Experience with time series databases like InfluxDB is advantageous* Strong skills in Docker, Git, pandas, regex, Linux, and bash scripting* Proven experience with AWS, GCP, or AzureRequisitos principales* Flexible working environment* Volunteer time off* LinkedIn Learning* Employee-Assistance-Program (EAP) ## Related Videos - [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [The Resilience of the World Wide Web](https://www.wearedevelopers.com/videos/1281-the-resilience-of-the-world-wide-web) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Scrape, Train, Predict: The Lifecycle of Data for AI Applications](https://www.wearedevelopers.com/videos/1652-scrape-train-predict-the-lifecycle-of-data-for-ai-applications) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 113 - Debugging above the cloud](https://www.wearedevelopers.com/magazine/422-dev-digest-113-debugging-above-the-cloud) - [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [Dev Digest 131 - AI'm not sure about OSS](https://www.wearedevelopers.com/magazine/472-dev-digest-131-ai-m-not-sure-about-oss)