> Markdown version of [/jobs/ext/1935347-back-end-software-engineer-web-scraping-data-acquisition](https://www.wearedevelopers.com/jobs/ext/1935347-back-end-software-engineer-web-scraping-data-acquisition). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Back end Software Engineer (web scraping/data acquisition) - **Company:** SAPIENT SEARCH GROUP LLC - **Location:** United States (Remote available) - **Experience:** Experienced - **Salary:** $170,000.0 - $200,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), JavaScript (Programming Language), Multitier Architecture, Amazon Web Services, Android Studio, Unit Testing, Web Scraping, Dependency Injection, Linux, Amazon DynamoDB, Github, CURL, Node.Js, Object-Oriented Software Development, Queueing Systems, Redis, E2e Testing, Reverse Engineering, Selenium, Software Engineering, Wireshark, TypeScript, Web Application Frameworks, Datadog, ReactJS, Amazon ElastiCache, Large Language Models, Cypress (Programming Language), Puppeteer (Software), Cloudformation, Vue.js, Information Technology, Playwright, JestJS, Amazon Simple Queue Service (SQS), Terraform, Domain Driven Design, New Relic (SaaS), Serverless Computing, Docker - **Published:** August 5, 2026 - **Apply:** https://arc.dev/remote-jobs/j/redirect/p9znveiava ## About the Role * Must have 10 years of Software Development experience * Must have 2+ years of experience with TypeScript/NodeJS and deep understanding of writing well-typed, object-oriented code * Must have experience running container based applications (Docker, Docker Compose) * Must have 2+ years experience leveraging HTTP knowledge and client skills, e.g. got, cURL, axios * Must be highly proficient in unit testing methodologies, e.g. with Jest or Vitest * Must have hands on experience coding applications that run and reside on AWS hosted solutions Related Qualifications * Experience with Dependency Injection/DI containers * Knowledge about best practices relative to end-to-end testing with e.g. Playwright, Puppeteer, Cypress, Selenium * Experience with Redis/Elasticache * Experience with DynamoDB * Broad Linux knowledge * Hands on experience setting up Monitoring/observability platforms, e.g. Datadog, New Relic * Must be familiar with using LLMs to increase engineering velocity while still maintaining high coding standards and developer-friendly code Nice to haves * Experience with man-in-the-middle techniques (Proxyman, HTTP Toolkit, Wireshark), reverse engineering, understanding decompiled code * Understanding of fingerprinting techniques (browser, OS, networking stack, etc.) * Work experience running applications on ECS/EKS * Has utilized and written Serverless functions (Lambda) * Knowledgeable about Queueing systems, e.g. SQS, BullMQ * Familiar with GitHub Actions * Has experience with Domain Driven Design/Clean Architecture * Has experience with Java/Android Studio * Worked with Front end frameworks, e.g. React, Vue * Has hand rolled infrastructure as code, e.g. CDK, SAM, CloudFormation, Terraform Education * Minimum of 5-10 years of experience in a software engineering role * Bachelor of Science Degree in Computer Science or commensurate experience Core Qualifications * Assist team members with problem-solving complex use cases and systems; while leading technical change and transformation in parallel. * Must be passionate about creating solutions, and solving problems - in the right way, at the right time, and for the right reasons. * Must be teachable, give and receive feedback, and demonstrate success in their discipline on a consistent and transparent basis. * Must be able to work on a team whose work is not cookie-cutter. Creative solutions are always needed, and there aren't straightforward answers to every question. Everyone on the team needs to be a confident, motivated self-starter who can work through difficult problems. ## Related Videos - [Navigating the Corporate Jungle: Life as a Developer in a large Company](https://www.wearedevelopers.com/videos/621-navigating-the-corporate-jungle-life-as-a-developer-in-a-large-company) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Don’t Insert Crazy! On cURL and AI Slop - Daniel Stenberg](https://www.wearedevelopers.com/videos/1796-don-t-insert-crazy-on-curl-and-ai-slop-daniel-stenberg) - [Exploiting the recruitment game as a developer](https://www.wearedevelopers.com/videos/750-exploiting-the-recruitment-game-as-a-developer) - [Accelerating Authentication Architecture: Taking Passwordless to the Next Level](https://www.wearedevelopers.com/videos/733-accelerating-authentication-architecture-taking-passwordless-to-the-next-level) ## Related Articles - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [7 Important Tips That Every Software Developer Should Know](https://www.wearedevelopers.com/magazine/101-7-important-tips-that-every-software-developer-should-know) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe) - [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers) - [What’s the Difference between a Junior, Mid, and Senior Developer?](https://www.wearedevelopers.com/magazine/238-what-s-the-difference-between-a-junior-mid-and-senior-developer)