Software Engineer

Digital Talent Agency
Municipality of Madrid, Spain
12 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Municipality of Madrid, Spain

Tech stack

API
Web Scraping
Python
Node.js
Systems Integration
Web Crawlers
Captcha
Real Time Data

Job description

Co-Founder @ Digital Waffle - The go-to partner when scaling your team within Tech, Digital, Marketing & Data - without the usual bullsh*t.

This role suits someone who has worked with web scraping, crawling, and automation frameworks, and who enjoys solving complex technical challenges around speed, reliability, and scale.

About the Company

An ambitious and fast scaling digital business that depends on reliable real time data collection to support commercial decision making. The team works with high volume traffic, fast moving datasets, and automation systems that need to remain robust and flexible as requirements evolve. What You Will Be Doing

  • Building and maintaining automated web crawlers that collect structured data at scale.
  • Integrating third party captcha solving APIs in a compliant way when required.
  • Designing resilient systems to avoid rate limit issues and maximise success rates.
  • Monitoring crawler performance and implementing fixes for reliability and speed.
  • Working closely with product and engineering teams to refine data requirements.
  • Ensuring all automation work is compliant with legal, ethical, and platform guidelines.

Requirements

  • Strong experience with Python, Node.js, or Go.
  • Experience working with web scraping libraries and proxies.
  • Knowledge of captcha solving APIs and challenges around automated form handling.
  • Familiarity with queue systems, distributed crawling, and scaling automation tools.
  • A problem solving mindset with strong attention to detail.
  • Ability to optimise scripts for stability and volume.

Apply for this position