Web Scraper - Barcelona
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+11 more
Job description
OverviewIn this role you will help optimize data collection as a Python Developer in our scraping team.You will design, implement, and document robust Scrapy spiders to withstand website changes while preserving existing functionality.You’ll ensure high data quality through code reviews and validation, and build sophisticated crawlers that navigate anti-bot measures.You will contribute to major developments across codebases and share knowledge through documentation and training.This is a chance to shape scalable data pipelines for real-time market visibility in a fast-growing, startup-minded environment.Compensaciones / BeneficiosFlexible working environmentVolunteer time offLinkedIn LearningEmployee-Assistance-Program (EAP)ResponsabilidadesDesign, implement and document Scrapy spiders for robust data collectionPerform code reviews and data validation to ensure qualityDevelop crawlers that handle anti-bot measures using HTTP and browser techniquesArchitect and contribute to new developments across multiple codebases with documentation and trainingCollaborate with cross-functional teams to share knowledge and enable tooling improvementsRequisitos principalesMaster in Computer Science, IT, or related fieldAt least 3 years of professional software engineering experienceKnowledge of BeautifulSoup or ScrapyFamiliarity with HTML and JavaScript, understanding of SPAsExperience with RESTful and/or GraphQL APIsHands-on experience with Django, FastAPI or similar Python frameworksScrapy knowledge is a plusExperience with time series databases like InfluxDB is advantageousStrong skills in Docker, Git, pandas, regex, Linux, and bash scriptingProven experience with AWS, GCP, or AzureEnthusiastic and motivatedAutonomous and proactiveEnjoys tackling challenging software engineering problemsScrapyBeautifulSoupHTML/JavaScript
Requirements
Requisitos principalesMaster in Computer Science, IT, or related field At least 3 years of professional software engineering experience Knowledge of BeautifulSoup or Scrapy Familiarity with HTML and JavaScript, understanding of SPAs Experience with RESTful and/or GraphQL APIs Hands-on experience with Django, FastAPI or similar Python frameworks Scrapy knowledge is a plus Experience with time series databases like InfluxDB is advantageous Strong skills in Docker, Git, pandas, regex, Linux, and bash scripting Proven experience with AWS, GCP, or Azure Enthusiastic and motivated Autonomous and proactive Enjoys tackling challenging software engineering problems Scrapy BeautifulSoup HTML/JavaScript
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Dev Digest 113 - Debugging above the cloud
Dev Digest 120 - Apple and peers
Dev Digest 121 - AI goes offline
Dev Digest 133 - Back to Front