Backend Engineer - Data Acquisition
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+4 more
Job description
Youâll join our Crawler Engineering team as a Backend Engineer focused on data acquisition. This is a building role: youâll design and develop high-performance systems, mostly in Rust, that collect billions of data points from the web. The work sits where backend engineering meets how the web works: HTTP stacks, proxies and browser tooling. When a data source blocks an approach, youâll dig into whatâs happening on the wire and find another way forward. Youâll also help make our infrastructure âagent-friendlyâ, so other teams can safely build on it with AI., * Design, build and improve backend systems for data acquisition that handle close to 200 million requests a day.
- Work on our in-house proxy layer and browser tooling: request routing, connection handling and protocol-level behaviour.
- Investigate hard crawler problems, test alternative approaches when one gets blocked, and turn what works into robust, reusable systems.
- Build clear interfaces and guardrails so other teams and AI agents can use what you build reliably.
- Own the quality of your code, including code written with AI assistance: tests, observability and maintainability.
- Work closely with crawler engineers, DevOps and Security to ship solutions that are secure and scalable.
Requirements
- You have hands on experience building, deploying and running production backend services in a cloud environment.
- Youâre experienced with a systems language such as Rust or C/C++, or you have a strong track record in another backend language and a real drive to go deep in Rust.
- You have a solid grasp of how the web works under the hood: HTTP, TCP/IP, TLS and proxies.
- You have an R&D mindset. Youâre curious about how browsers and network stacks work internally, youâre comfortable with ambiguity, and youâd rather prove a hypothesis than assume it.
- You have strong analytical and debugging skills. Youâre comfortable with packet captures, profilers and reading other peopleâs source code.
- You communicate clearly, share your opinions, welcome feedback and work well in a team.
- Youâre fluent in English.
Technologies you will work with
Rust, TypeScript/Node.js, Python, Google Cloud, Kubernetes, Prometheus, Grafana, Claude Code.
Benefits & conditions
Whatâs in it for you?
- Flexible working environment: Work from home or at one of our global offices.
- Flexible time off: Autonomy to manage your work-life balance.
- Alan Healthy benefits: 160âŹ/month for food or nursery.
- Payflow App: Access your earned salary in advance at no cost to you.
- Flexible retribution: Optional benefits through tax-free payroll deductions for food, transportation and/or nursery.
- Wellbeing support: Subsidized up to 80% ClassPass subscription.
- Comprehensive health insurance: 100% Alan coverage for you, your spouse, and dependents.
- Collaborative team: High-bar, friendly, creative, and passionate colleagues.
- Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
- Impactful work: Shape products relied on by 85,000+ users worldwide.
- Competitive compensation: Proactively maintained to value your work.
- Referral bonuses: Earn rewards for bringing in new talent.
About the company
At Lighthouse, weâre on a mission to revolutionize commercial strategy as hospitalityâs most powerful AI platform. We take the worldâs largest hotel data network and transform it into real-time intelligence that drives action. We donât just deliver insights; we empower businesses to make decisions that move revenue.
With $370M in Series C funding and over $100M in ARR, we are scaling at lightspeed. Our 850+ teammates across 35 countries arenât just building software-they are leveraging cutting-edge AI to help hoteliers be the first to act. Tens of thousands of hotels across 185 countries trust Lighthouse to execute their commercial strategy, including every one of the top 15 global chains and thousands of independent hotels that consistently outperform their markets. With Lighthouse AI, the intelligence gets deeper. Decisions get smarter. Actions get faster. We help hoteliers be first to act.
Lighthouse Values: Our guiding light
We are Lumineers. Our shared values keep us on a collaborative path fostering a cultural and customer centric environment
- Pursuit of greatness: Weâre innovators who care deeply about our customersâ success. Our team brings their best work, stays curious, and delivers excellence through attention to detail
- Meaningful work matters: We make every moment count by knowing what to deliver, why it matters, and how it drives Lighthouse forward
- Elevate each other: We donât just work together - we grow together. What unites us is understanding each other as people and working toward shared goals
Weâre more than just a workplace - weâre a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industryâs most exciting rocket-ship?, The Crawler engineering team makes sure Lighthouse customers get fresh, high-quality rates, ranking and supply data. We handle close to 200 million requests a day across 200+ data sources, so the team carries a big responsibility for keeping our crawling infrastructure reliable, efficient and ahead of a web that keeps changing.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role â technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Find a Developer Job: 12 Best Job Sites For Developers
Dev Digest 120 - Apple and peers
Fully Remote Software Engineer Jobs
Where To Find Software Engineering Jobs