Senior Web Scraper | Beautifulsoup Or Scrapy

Experteer Overview As Senior Python Developer in our scraping team, you will optimize data collection by building robust Scrapy spiders and ensuring resilient crawlers against website changes.You will uphold code and data quality through reviews and validation, and design sophisticated crawling solutions that navigate anti-bot measures.You’ll contribute to major builds across codebases, documenting clearly and sharing knowledge with relevant teams.This role sits in a fast-growing, start-up-spirited NIQ for Digital Commerce, focused on real-time retail insights.Compensaciones / Beneficios * Design, implement and document robust Scrapy spiders * Perform code reviews and data validation to ensure quality * Develop web crawling solutions that bypass advanced anti-bot measures * Architect new features across multiple codebases with clear documentation * Provide training and knowledge sharing to relevant teams Responsabilidades * Master’s degree in Computer Science, IT, or related field * At least 3 years of professional software engineering experience * Knowledge of BeautifulSoup or Scrapy * Familiarity with HTML and JavaScript, understanding of single-page applications * Experience with RESTful and/or GraphQL APIs * Hands-on experience with Django, FastAPI, or similar Python web frameworks * Knowledge of Scrapy is a plus * Experience with time series databases (InfluxDB) is advantageous * Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting * Experience with AWS, GCP, or Azure * Enthusiastic, motivated, autonomous; enjoys tackling challenging software problems * Passionate about tech and continuous learning Requisitos principales * Flexible working environment * Volunteer time off * LinkedIn Learning * Employee-Assistance-Program (EAP)

Compensaciones / Beneficios * Design, implement and document robust Scrapy spiders * Perform code reviews and data validation to ensure quality * Develop web crawling solutions that bypass advanced anti-bot measures * Architect new features across multiple codebases with clear documentation * Provide training and knowledge sharing to relevant teams Responsabilidades * Master’s degree in Computer Science, IT, or related field * At least 3 years of professional software engineering experience * Knowledge of BeautifulSoup or Scrapy * Familiarity with HTML and JavaScript, understanding of single-page applications * Experience with RESTful and/or GraphQL APIs * Hands-on experience with Django, FastAPI, or similar Python web frameworks * Knowledge of Scrapy is a plus * Experience with time series databases (InfluxDB) is advantageous * Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting * Experience with AWS, GCP, or Azure * Enthusiastic, motivated, autonomous; enjoys tackling challenging software problems * Passionate about tech and continuous learning Requisitos principales * Flexible working environment * Volunteer time off * LinkedIn Learning * Employee-Assistance-Program (EAP)