> Markdown version of [/jobs/ext/231871-web-scraping-engineer](https://www.wearedevelopers.com/jobs/ext/231871-web-scraping-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Web Scraping Engineer

- **Company:** ALPHAMATICIAN LLC
- **Location:** United States
- **Contract:** Permanent contract
- **Skills:** PHP (Programming Language), CodeIgniter, Web Scraping, Python (Programming Language), MySQL, Node.Js, Selenium, Captcha, Puppeteer (Software), Playwright
- **Published:** May 26, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=502f7822d2656f91

## About the Role

Do you have experience in Scalable systems?, * Production PHP experience. CodeIgniter 4 is a strong plus. You must be able to point to public PHP work: a repo, contributions to a project, a blog post, or similar.

 * Python proficiency with modern scraping libraries. Working fluency in Playwright, Scrapy, Selenium, Requests, httpx, BeautifulSoup, or comparable.
 * Demonstrated experience scraping hard targets at scale. Sites with active anti-bot defenses, dynamic rendering, rate-limit walls, or aggressive blocking. You must include a link to public scraping work in your application, or describe a specific scraper you built in detail (target, defenses encountered, how you solved them).
 * MySQL competence. Reading, writing, and optimizing non-trivial queries against tables with hundreds of millions of rows.
 * Schedule. 7am US Eastern start.
 * US-based with verifiable employment history.

Strong Plusses:

 * Direct experience with anti-bot evasion: residential proxies, TLS fingerprint matching, JA3, header rotation, CAPTCHA strategy.
 * Comfort with mature, incrementally maintained codebases rather than green-field environments.
 * Background in financial data, alternative data, or equity research.
 * Node.js, Puppeteer, or additional automation tooling.

## Description

* Morning (7am ET). Review overnight pipeline logs. Identify failures, anomalies, or coverage gaps. Triage fixes and follow-ups.
 * Engineering work. Fix PHP bugs. Update scrapers as target sites change their structure or defenses. Update cron logic. Ship incremental improvements to collection coverage and quality.
 * Data quality. Run checks against current and historical baselines to confirm coverage and accuracy.
 * Client questions. Respond to client inquiries about coverage, methodology, or anomalies as they come in.
 * Strategy. Periodically discuss collection strategies, help scope and stand up new datasets, and contribute to new products and features.

This is operational work with a steady rhythm. The reward is in keeping an important data product running well, and in being good at a specific kind of hard problem (scraping hard sites at scale) that few people are actually good at.


## Related Videos

- [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping)
- [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of)
- [Stop using Node.js like in 2020! What changed and what you can do today with Node.js](https://www.wearedevelopers.com/videos/100011-stop-using-node-js-like-in-2020-what-changed-and-what-you-can-do-today-with-node-js)
- [Scrape, Train, Predict: The Lifecycle of Data for AI Applications](https://www.wearedevelopers.com/videos/1652-scrape-train-predict-the-lifecycle-of-data-for-ai-applications)
- [How to scrape modern websites to feed AI agents](https://www.wearedevelopers.com/videos/1446-how-to-scrape-modern-websites-to-feed-ai-agents)
- [Coding for Good: Achieving social change with an app](https://www.wearedevelopers.com/videos/1645-coding-for-good-achieving-social-change-with-an-app)

## Related Articles

- [What Developers Are Building to Win $1 Million with Apify](https://www.wearedevelopers.com/magazine/677-what-developers-are-building-to-win-1-million-with-apify)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)
- [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)