> Markdown version of [/jobs/ext/2011547-senior-software-engineer-web-scraping-data-acquisition-data-collection](https://www.wearedevelopers.com/jobs/ext/2011547-senior-software-engineer-web-scraping-data-acquisition-data-collection). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer (Web Scraping, Data Acquisition, Data Collection)

- **Company:** Nielseniq
- **Location:** Barcelona, Spain
- **Contract:** Permanent contract
- **Skills:** JavaScript (Programming Language), Application Programming Interfaces (APIs), Databases, Data Centers, Web Scraping, Software Debugging, Python (Programming Language), MongoDB, Redis, Reverse Engineering, Selenium, Session Management, Parquet, Build Management, Influxdb, Playwright, Avro, Mitmproxy, Stream Processing
- **Published:** August 10, 2026
- **Apply:** https://www.buscojobs.com.es/senior-software-engineer-web-scraping-data-acquisition-data-collection-en-barcelona-ID-366901314

## About the Role

This is a hands-on, problem?solving role for someone who loves turning difficult data problems into reliable solutions.Compensaciones / Beneficios* Design and build scalable distributed scraping architectures for thousands of domains* Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp* Detect and bypass anti-bot measures to create human-like crawlers* Lead technical innovation in scraping, prototype approaches, share knowledge with the team* Set up anomaly detection and monitoring to catch blockers or failures earlyResponsabilidades* 5+ years of Python experience and involvement in large-scale scraping projects* Deep understanding of anti-bot technologies and bypass techniques, fingerprinting, WAFs, JavaScript challenges* Experience with Scrapy, Requests, httpx, Selenium, Playwright or similar headless drivers* Proficiency with proxies (residential, datacenter, rotating), session management, cookie injection, xqbhyrx TLS tweaking* Strong debugging
skills across browser, HTTP traffic, and device-level interactions* Independent problem solver with a track record of solving new problems* Familiarity with Parquet, Avro or real-time stream processing* Knowledge of databases like MongoDB, InfluxDB, and Redis and how to optimize themRequisitos principales* Flexible working environment* Volunteer time off* LinkedIn Learning* Employee-Assistance-Program (EAP)

## Description

Experteer Overview La información a continuación detalla los requisitos del puesto, la experiencia esperada del candidato y las cualificaciones correspondientes.In this role you will design and operate scalable distributed scraping systems to extract high-quality data from thousands of domains.You will work within the Scraping and Ru****amp;D team to push innovative approaches and share knowledge, collaborating with Customer Success, Operations, and Data.You'll tackle anti-bot challenges and build monitoring to prevent blockers, contributing to fast, scalable visibility for retailers and brands.This is a hands-on, problem?solving role for someone who loves turning difficult data problems into reliable solutions.Compensaciones / Beneficios* Design and build scalable distributed scraping architectures for thousands of domains* Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp* Detect and bypass anti-bot measures to create human-like crawlers* Lead technical innovation in scraping, prototype approaches, share knowledge with the team* Set up anomaly detection and monitoring to catch blockers or failures earlyResponsabilidades* 5+ years of Python experience and involvement in large-scale scraping projects* Deep understanding of anti-bot technologies and bypass techniques, fingerprinting, WAFs, JavaScript challenges* Experience with Scrapy, Requests, httpx, Selenium, Playwright or similar headless drivers* Proficiency with proxies (residential, datacenter, rotating), session management, cookie injection, xqbhyrx TLS tweaking* Strong debugging skills across browser, HTTP traffic, and device-level interactions* Independent problem solver with a track record of solving new problems* Familiarity with Parquet, Avro or real-time stream processing* Knowledge of databases like MongoDB, InfluxDB, and Redis and how to optimize themRequisitos principales* Flexible working environment* Volunteer time off* LinkedIn Learning* Employee-Assistance-Program (EAP)


## Related Videos

- [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101)
- [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping)
- [40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs](https://www.wearedevelopers.com/videos/208-40-minutes-to-build-a-serverless-covid-19-rest-and-graphql-apis)
- [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis)
- [Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations](https://www.wearedevelopers.com/videos/2046-modern-web-data-extraction-techniques-tools-and-legal-ethical-considerations)
- [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers)

## Related Articles

- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Dev Digest 139 - Soft and hard queries](https://www.wearedevelopers.com/magazine/487-dev-digest-139-soft-and-hard-queries)
- [Dev Digest 131 - AI'm not sure about OSS](https://www.wearedevelopers.com/magazine/472-dev-digest-131-ai-m-not-sure-about-oss)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)