> Markdown version of [/jobs/ext/3516374-backend-engineer-data-acquisition](https://www.wearedevelopers.com/jobs/ext/3516374-backend-engineer-data-acquisition). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Backend Engineer - Data Acquisition - **Company:** Why Lighthouse - **Location:** Barcelona, Spain (Remote available) - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, C++ (Programming Language), Cloud Computing, Profiling, Software Debugging, DevOps, Python (Programming Language), Node.Js, Prometheus, TCP/IP, TypeScript, Google Cloud, Grafana, Backend, Kubernetes, Virtual Agents - **Published:** September 30, 2026 - **Apply:** https://startup.jobs/backend-engineer-data-acquisition-lighthouse-10231523 ## About the Role * You have hands on experience building, deploying and running production backend services in a cloud environment. * You're experienced with a systems language such as Rust or C/C++, or you have a strong track record in another backend language and a real drive to go deep in Rust. * You have a solid grasp of how the web works under the hood: HTTP, TCP/IP, TLS and proxies. * You have an R&D mindset. You're curious about how browsers and network stacks work internally, you're comfortable with ambiguity, and you'd rather prove a hypothesis than assume it. * You have strong analytical and debugging skills. You're comfortable with packet captures, profilers and reading other people's source code. * You communicate clearly, share your opinions, welcome feedback and work well in a team. * You're fluent in English. Technologies you will work with Rust, TypeScript/Node.js, Python, Google Cloud, Kubernetes, Prometheus, Grafana, Claude Code. ## Description You'll join our Crawler Engineering team as a Backend Engineer focused on data acquisition. This is a building role: you'll design and develop high-performance systems, mostly in Rust, that collect billions of data points from the web. The work sits where backend engineering meets how the web works: HTTP stacks, proxies and browser tooling. When a data source blocks an approach, you'll dig into what's happening on the wire and find another way forward. You'll also help make our infrastructure "agent-friendly", so other teams can safely build on it with AI., * Design, build and improve backend systems for data acquisition that handle close to 200 million requests a day. * Work on our in-house proxy layer and browser tooling: request routing, connection handling and protocol-level behaviour. * Investigate hard crawler problems, test alternative approaches when one gets blocked, and turn what works into robust, reusable systems. * Build clear interfaces and guardrails so other teams and AI agents can use what you build reliably. * Own the quality of your code, including code written with AI assistance: tests, observability and maintainability. * Work closely with crawler engineers, DevOps and Security to ship solutions that are secure and scalable. ## Related Videos - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Stop using Node.js like in 2020! What changed and what you can do today with Node.js](https://www.wearedevelopers.com/videos/100011-stop-using-node-js-like-in-2020-what-changed-and-what-you-can-do-today-with-node-js) - [An Applied Introduction to eBPF with Go](https://www.wearedevelopers.com/videos/1075-an-applied-introduction-to-ebpf-with-go) - [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better) - [Stop Using Node.js Like It’s 2020! - Alfonso Graziano](https://www.wearedevelopers.com/videos/1863-stop-using-node-js-like-it-s-2020-alfonso-graziano) - [Turning Container security up to 11 with Capabilities](https://www.wearedevelopers.com/videos/718-turning-container-security-up-to-11-with-capabilities) ## Related Articles - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)