> Markdown version of [/jobs/ext/279214-software-engineer-iii](https://www.wearedevelopers.com/jobs/ext/279214-software-engineer-iii). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer III - **Company:** Babel - **Location:** Somerville, MA, United States (Remote available) - **Experience:** Expert - **Salary:** $110,000.0 - $135,000.0 - **Contract:** Permanent contract - **Skills:** JavaScript (Programming Language), Big Data, Information Systems, Computer Networks, Databases, Web Scraping, Data Mining, Relational Databases, Software Debugging, Programming Tools, Distributed Computing Environment, Python (Programming Language), PostgreSQL, MySQL, Performance Tuning, Akamai, Standard Sql, Reverse Engineering, Selenium, Software Engineering, SQL Databases, TCP/IP, Web Applications, Sql Optimization, Captcha, Puppeteer (Software), Information Technology, Playwright, Cloudflare, Web Api - **Published:** May 21, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=00df9ee9735449cc ## About the Role Do you have experience in Technical troubleshooting support?, Do you have a Bachelor's degree?, We are looking for a Senior Python Engineer with a "hacker" mindset to join our team as a Software Engineer III. This role is dedicated to large-scale web scraping and data harvesting. If you have deep experience with Scrapy or Playwright, know how to defeat Cloudflare or DataDome, and can write high-performance SQL to manage millions of records, we want to hear from you. This is a specialized role for an engineer who enjoys reverse-engineering the web to unlock data., * Advanced Python: Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer). * Technical Resilience: Proven ability to bypass high-level bot detection (e.g., Cloudflare, Akamai, or PerimeterX). * Database Mastery: Expert-level SQL skills and experience managing relational databases like PostgreSQL or MySQL. * Network Proficiency: Expert understanding of HTTP/S, TCP/IP, TLS fingerprinting, and browser-header manipulation. * Problem Solving: A specialized ability to reverse-engineer JavaScript-heavy websites and hidden API endpoints. * Able to write, debug, and deploy complex Python code in a distributed environment. * Must be able to analyze and interpret complex web structures and network traffic using browser developer tools. * Ability to design and maintain relational database tables containing millions of rows. * Able to pivot and respond quickly to technical "break-fixes" to ensure data continuity for the business. * Collaboration with data analysts to define and validate data requirements and output formats. Education & Experience: * Bachelor's degree in Computer Science, Information Systems, or a related field (or equivalent professional experience). * Minimum of 5+ years of experience in Software Engineering, with at least 2-3 years focused specifically on large-scale web scraping or data extraction. ## Description The primary purpose of this Software Engineer III position is to architect, develop, and maintain advanced automated data extraction systems (spiders) that harvest critical business intelligence from complex web environments. This role ensures the continuous, reliable flow of high-quality data into our internal databases by engineering solutions to overcome sophisticated technical barriers and anti-bot security measures. Candidates near our Somerville, MA or Reston, VA offices are preferred but remote work it potential for the ideal candidate., As a Software Engineer III specializing in data extraction, you will be responsible for the end-to-end lifecycle of web-based data collection. This includes designing scalable crawling architectures, reverse-engineering web applications to identify data points, and implementing evasion techniques to bypass IP rate-limiting and bot detection. You will also manage the storage and integrity of this data using advanced SQL and relational database management., The primary purpose of this Software Engineer III position is to architect, develop, and maintain advanced automated data extraction systems (spiders) that harvest critical business intelligence from complex web environments. This role ensures the continuous, reliable flow of high-quality data into our internal databases by engineering solutions to overcome sophisticated technical barriers and anti-bot security measures., * Spider Development: Design and deploy robust, distributed spiders and crawlers to extract data from a variety of web architectures (SPAs, SSR, etc.). * Bot Evasion Engineering: Research and implement strategies to bypass anti-scraping technologies, including proxy rotation, browser fingerprinting, and CAPTCHA solving. * Database Management: Create and optimize SQL schemas for large-scale data storage and perform complex data transformations and validation. * System Maintenance: Proactively monitor the health of extraction agents and refactor code quickly in response to target website updates or layout changes. * Performance Optimization: Utilize asynchronous Python programming to maximize the throughput and efficiency of data collection pipelines. ## Related Videos - [What the Heck is Edge Computing Anyway?](https://www.wearedevelopers.com/videos/593-what-the-heck-is-edge-computing-anyway) - [An Applied Introduction to eBPF with Go](https://www.wearedevelopers.com/videos/1075-an-applied-introduction-to-ebpf-with-go) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping) - [Turning Container security up to 11 with Capabilities](https://www.wearedevelopers.com/videos/718-turning-container-security-up-to-11-with-capabilities) - [Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations](https://www.wearedevelopers.com/videos/2046-modern-web-data-extraction-techniques-tools-and-legal-ethical-considerations) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)