> Markdown version of [/jobs/ext/2999632-web-scraper](https://www.wearedevelopers.com/jobs/ext/2999632-web-scraper). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Web scraper

- **Company:** Niq For Digital Commerce
- **Location:** Barcelona, Spain
- **Contract:** Permanent contract
- **Skills:** HTML, JavaScript (Programming Language), Application Programming Interfaces (APIs), Amazon Web Services, Microsoft Azure, Bash Shell, Code Review, Data Validation, Linux, Django Web Framework, Hypertext Transfer Protocols (HTTP), Web Browsers, Python (Programming Language), Regular Expressions, Software Engineering, Web Application Frameworks, Web Crawlers, Time Series Databases, Git, Fastapi, Pandas, Single Page Application, Information Technology, Restful APIs, Docker
- **Published:** September 19, 2026
- **Apply:** https://www.recruit.net/job/web-scraper-jobs/04EAE336648C5ABE

## About the Role

Master's degree in Computer Science, IT, or a related field. At least 3 years of professional experience in software engineering. Knowledge of Beautiful Soup or Scrapy framework Familiarity with HTML and Java Script, with a solid understanding of single-page applications. Experience with RESTful and/or Graph QL APIs. Hands-on experience with major Python web frameworks such as Django, Fast API, or similar. Knowledge of the scraping framework, Scrapy is a plus. Experience with time series databases, such as Influx DB, is advantageous. Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting. Proven experience with major cloud providers such as AWS, GCP, or Azure. You are enthusiastic, motivated, autonomous. You like tackling mentally-stimulating software engineering challenges. You are passionate about tech and learning new things.

## Description

As a Python Developer within the scraping team, you will be among our talented and passionate team helping us optimize data collection!

Design, implement, and document robust Scrapy spiders, ensuring resilience against future website changes while maintaining existing ones. Conduct comprehensive code review and data validation to maintain the highest standards of code and data quality. Leverage in-depth knowledge of the HTTP protocol, the mechanisms of modern web browsers, and our own internal tools to design sophisticated web crawling solutions that bypass advanced anti-bot countermeasures. Architect and contribute to significant new developments across multiple codebases, providing clear technical documentation and conducting training sessions for relevant teams when necessary.


## Related Videos

- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [The Resilience of the World Wide Web](https://www.wearedevelopers.com/videos/1281-the-resilience-of-the-world-wide-web)
- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations](https://www.wearedevelopers.com/videos/2046-modern-web-data-extraction-techniques-tools-and-legal-ethical-considerations)
- [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025)
- [Dev Digest 113 - Debugging above the cloud](https://www.wearedevelopers.com/magazine/422-dev-digest-113-debugging-above-the-cloud)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers)
- [The 7 Most Popular Backend Frameworks for Developers](https://www.wearedevelopers.com/magazine/403-the-7-most-popular-backend-frameworks-for-developers)
- [Dev Digest 139 - Soft and hard queries](https://www.wearedevelopers.com/magazine/487-dev-digest-139-soft-and-hard-queries)