> Markdown version of [/jobs/ext/2947493-senior-web-scraper-beautifulsoup-or-scrapy](https://www.wearedevelopers.com/jobs/ext/2947493-senior-web-scraper-beautifulsoup-or-scrapy). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Web Scraper | Beautifulsoup Or Scrapy

- **Company:** Nielseniq
- **Location:** Barcelona, Spain
- **Contract:** Permanent contract
- **Skills:** HTML, JavaScript (Programming Language), Amazon Web Services, Microsoft Azure, Bash Shell, Code Review, Data Validation, Linux, Django Web Framework, Python (Programming Language), Regular Expressions, Software Engineering, Web Application Frameworks, Web Crawlers, Time Series Databases, Git, Fastapi, Pandas, Single Page Application, Information Technology, Influxdb, Graphql, Restful APIs, Docker
- **Published:** September 16, 2026
- **Apply:** https://www.buscojobs.com.es/senior-web-scraper-beautifulsoup-or-scrapy-en-barcelona-ID-370659501

## About the Role

Compensaciones / Beneficios * Design, implement and document robust Scrapy spiders * Perform code reviews and data validation to ensure quality * Develop web crawling solutions that bypass advanced anti-bot measures * Architect new features across multiple codebases with clear documentation * Provide training and knowledge sharing to relevant teams Responsabilidades * Master's degree in Computer Science, IT, or related field * At least 3 years of professional software engineering experience * Knowledge of BeautifulSoup or Scrapy * Familiarity with HTML and JavaScript, understanding of single-page applications * Experience with RESTful and/or GraphQL APIs * Hands-on experience with Django, FastAPI, or similar Python web frameworks * Knowledge of Scrapy is a plus * Experience with time series databases (InfluxDB) is advantageous * Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting * Experience with AWS, GCP, or Azure * Enthusiastic,
motivated, autonomous; enjoys tackling challenging software problems * Passionate about tech and continuous learning Requisitos principales * Flexible working environment * Volunteer time off * LinkedIn Learning * Employee-Assistance-Program (EAP)

## Description

Experteer Overview As Senior Python Developer in our scraping team, you will optimize data collection by building robust Scrapy spiders and ensuring resilient crawlers against website changes.You will uphold code and data quality through reviews and validation, and design sophisticated crawling solutions that navigate anti-bot measures.You'll contribute to major builds across codebases, documenting clearly and sharing knowledge with relevant teams.This role sits in a fast-growing, start-up-spirited NIQ for Digital Commerce, focused on real-time retail insights.Compensaciones / Beneficios * Design, implement and document robust Scrapy spiders * Perform code reviews and data validation to ensure quality * Develop web crawling solutions that bypass advanced anti-bot measures * Architect new features across multiple codebases with clear documentation * Provide training and knowledge sharing to relevant teams Responsabilidades * Master's degree in Computer Science, IT, or related field * At least 3 years of professional software engineering experience * Knowledge of BeautifulSoup or Scrapy * Familiarity with HTML and JavaScript, understanding of single-page applications * Experience with RESTful and/or GraphQL APIs * Hands-on experience with Django, FastAPI, or similar Python web frameworks * Knowledge of Scrapy is a plus * Experience with time series databases (InfluxDB) is advantageous * Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting * Experience with AWS, GCP, or Azure * Enthusiastic, motivated, autonomous; enjoys tackling challenging software problems * Passionate about tech and continuous learning Requisitos principales * Flexible working environment * Volunteer time off * LinkedIn Learning * Employee-Assistance-Program (EAP)


## Related Videos

- [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [The Resilience of the World Wide Web](https://www.wearedevelopers.com/videos/1281-the-resilience-of-the-world-wide-web)
- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations](https://www.wearedevelopers.com/videos/2046-modern-web-data-extraction-techniques-tools-and-legal-ethical-considerations)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Dev Digest 133 - Back to Front](https://www.wearedevelopers.com/magazine/474-dev-digest-133-back-to-front)
- [Dev Digest 113 - Debugging above the cloud](https://www.wearedevelopers.com/magazine/422-dev-digest-113-debugging-above-the-cloud)
- [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 139 - Soft and hard queries](https://www.wearedevelopers.com/magazine/487-dev-digest-139-soft-and-hard-queries)