> Markdown version of [/jobs/ext/3074941-senior-software-engineer-web-scraping-data-acquisition-data-collection-nielseniq](https://www.wearedevelopers.com/jobs/ext/3074941-senior-software-engineer-web-scraping-data-acquisition-data-collection-nielseniq). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer (Web Scraping, Data Acquisition, Data Collection) - Nielseniq

- **Company:** Jobrapido
- **Location:** Barcelona, Spain
- **Contract:** Permanent contract
- **Skills:** JavaScript (Programming Language), Application Programming Interfaces (APIs), Databases, Data Centers, Web Scraping, Software Debugging, Python (Programming Language), MongoDB, Redis, Reverse Engineering, Selenium, Session Management, Parquet, Influxdb, Playwright, Avro, Mitmproxy, Stream Processing
- **Published:** September 25, 2026
- **Apply:** https://www.buscojobs.com.es/senior-software-engineer-web-scraping-data-acquisition-data-collection-nielseniq-en-barcelona-ID-373107296

## About the Role

Requisitos principales5+ years of Python experience and involvement in large-scale scraping projects
Deep understanding of anti-bot technologies and bypass techniques, fingerprinting, WAFs, JavaScript challenges
Experience with Scrapy, Requests, httpx, Selenium, Playwright or similar headless drivers
Proficiency with proxies (residential, datacenter, rotating), session management, cookie injection, TLS tweaking
Strong debugging skills across browser, HTTP traffic, xqziphu and device-level interactions
Independent problem solver with a track record of solving new problems
Familiarity with Parquet, Avro or real-time stream processing
Knowledge of databases like MongoDB, InfluxDB, and Redis and how to optimize them
Independent thinking
Strong problem-solving abilities
Self-motivation and proactivity
Python for large-scale scraping
Anti-bot bypass techniques, fingerprinting, WAFs, JavaScript challenges
Scrapy, Requests, httpx, Selenium, Playwright or headless drivers

## Description

OverviewHaga clic en "Solicitar" a continuación para enviar su candidatura.Asegúrese de que su CV está actualizado y de que ha leído primero las especificaciones del puesto.In this role you will design and operate scalable distributed scraping systems to extract high-quality data from thousands of domains.You will work within the Scraping and R&D team to push innovative approaches and share knowledge, collaborating with Customer Success, Operations, and Data.You'll tackle anti-bot challenges and build monitoring to prevent blockers, contributing to fast, scalable visibility for retailers and brands.This is a hands-on, problem?solving role for someone who loves turning difficult data problems into reliable solutions.Compensaciones / BeneficiosFlexible working environmentVolunteer time offLinkedIn LearningEmployee-Assistance-Program (EAP)ResponsabilidadesDesign and build scalable distributed scraping architectures for thousands of domainsReverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burpDetect and bypass anti-bot measures to create human-like crawlersLead technical innovation in scraping, prototype approaches, share knowledge with the teamSet up anomaly detection and monitoring to catch blockers or failures earlyRequisitos principales5+ years of Python experience and involvement in large-scale scraping projectsDeep understanding of anti-bot technologies and bypass techniques, fingerprinting, WAFs, JavaScript challengesExperience with Scrapy, Requests, httpx, Selenium, Playwright or similar headless driversProficiency with proxies (residential, datacenter, rotating), session management, cookie injection, TLS tweakingStrong debugging skills across browser, HTTP traffic, xqziphu and device-level interactionsIndependent problem solver with a track record of solving new problemsFamiliarity with Parquet, Avro or real-time stream processingKnowledge of databases like MongoDB, InfluxDB, and Redis and how to optimize themIndependent thinkingStrong problem-solving abilitiesSelf-motivation and proactivityPython for large-scale scrapingAnti-bot bypass techniques, fingerprinting, WAFs, JavaScript challengesScrapy, Requests, httpx, Selenium, Playwright or headless drivers


## Related Videos

- [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101)
- [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping)
- [40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs](https://www.wearedevelopers.com/videos/208-40-minutes-to-build-a-serverless-covid-19-rest-and-graphql-apis)
- [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis)
- [Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations](https://www.wearedevelopers.com/videos/2046-modern-web-data-extraction-techniques-tools-and-legal-ethical-considerations)
- [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers)

## Related Articles

- [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Dev Digest 113 - Debugging above the cloud](https://www.wearedevelopers.com/magazine/422-dev-digest-113-debugging-above-the-cloud)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)