Senior Scraping Engineer (Web scraping & Anti-bot)

Infatica
Spain
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
4 years minimum
Working hours
Regular working hours
Languages
English
Job source

Tech stack

Application Programming Interfaces (APIs) Software Quality Continuous Integration Information Engineering Web Scraping Software Debugging DevOps Python (Programming Language) Message Broker Redis Prometheus Akamai
+12 more
Selenium Session Management Captcha Grafana Kubernetes Helm Charts Puppeteer (Software) Backend Kubernetes Playwright Cloudflare Docker Microservices

Job description

Architecture Design

  • Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
  • Control-plane: API, authorization, billing, quotas, monitoring
  • Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Ownership

  • Establish development and release processes
  • Code quality control and technical decision oversight

Anti-Bot Research & Bypass

  • Browser and network-level fingerprinting (JA3, TLS, CDP)
  • Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

  • CI/CD setup, Helm charts, scaling configuration
  • Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

Do you have experience in Selenium?, 4-6+ years in backend, data engineering, automation, or high-load systems.

  • Strong production web scraping experience with protected / dynamic / JS-heavy websites.
  • Python async stack; Go experience is a plus.
  • Experience with Playwright, Puppeteer, Selenium, Scrapy, browser automation, CDP.
  • Strong understanding of HTTP, TLS, HTTP/2, cookies, sessions, headers, proxies.
  • Redis, queues/message brokers, Docker, CI/CD, observability.
  • Kubernetes experience is preferred; deep K8s/SRE is a plus, not a hard blocker within this budget.
  • Ability to write clear technical documentation in English.
  • Ownership mindset: reliability, monitoring, incident debugging, cost control

Benefits & conditions

  • Participate in developing the company’s key product from scratch

  • High autonomy and influence on architecture and team decisions
  • Budget for conferences, courses, and work tools
  • Competitive compensation package
  • Remote work flexibility

Join us

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

About the company

Infatica.io is a global provider of proxy and DaaS solutions. We’re building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Engineer for our web scraping development team who will lead and drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

5:54 min

The technical evolution of modern web scraping infrastructure

Chris Heilmann +4 · LIVE

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

3:43 min

Scaling web scraping infrastructure to bypass strict security restrictions

Tim Ruscica · Coffee With Developers

3:42 min

Comparing in-memory and Redis storage for cache scalability

Simone Sanfratello · WWC 2022

Videos

See all

Related articles

See all