Backend Engineer - Data Acquisition

Why Lighthouse
Gent, Belgium
3 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Job source

Tech stack

Artificial Intelligence C++ (Programming Language) Cloud Computing Profiling Software Debugging DevOps Python (Programming Language) Node.Js Prometheus TCP/IP TypeScript Google Cloud
+4 more
Grafana Backend Kubernetes Virtual Agents

Job description

You’ll join our Crawler Engineering team as a Backend Engineer focused on data acquisition. This is a building role: you’ll design and develop high-performance systems, mostly in Rust, that collect billions of data points from the web. The work sits where backend engineering meets how the web works: HTTP stacks, proxies and browser tooling. When a data source blocks an approach, you’ll dig into what’s happening on the wire and find another way forward. You’ll also help make our infrastructure “agent-friendly”, so other teams can safely build on it with AI., * Design, build and improve backend systems for data acquisition that handle close to 200 million requests a day.

  • Work on our in-house proxy layer and browser tooling: request routing, connection handling and protocol-level behaviour.
  • Investigate hard crawler problems, test alternative approaches when one gets blocked, and turn what works into robust, reusable systems.
  • Build clear interfaces and guardrails so other teams and AI agents can use what you build reliably.
  • Own the quality of your code, including code written with AI assistance: tests, observability and maintainability.
  • Work closely with crawler engineers, DevOps and Security to ship solutions that are secure and scalable.

Requirements

  • You have hands on experience building, deploying and running production backend services in a cloud environment.
  • You’re experienced with a systems language such as Rust or C/C++, or you have a strong track record in another backend language and a real drive to go deep in Rust.
  • You have a solid grasp of how the web works under the hood: HTTP, TCP/IP, TLS and proxies.
  • You have an R&D mindset. You’re curious about how browsers and network stacks work internally, you’re comfortable with ambiguity, and you’d rather prove a hypothesis than assume it.
  • You have strong analytical and debugging skills. You’re comfortable with packet captures, profilers and reading other people’s source code.
  • You communicate clearly, share your opinions, welcome feedback and work well in a team.
  • You’re fluent in English.

Technologies you will work with

Rust, TypeScript/Node.js, Python, Google Cloud, Kubernetes, Prometheus, Grafana, Claude Code.

Benefits & conditions

What’s in it for you?

  • Flexible working environment: Work from home or at one of our global offices.
  • Flexible time off: Autonomy to manage your work-life balance.
  • Collaborative team: High-bar, friendly, creative, and passionate colleagues.
  • Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
  • Impactful work: Shape products relied on by 85,000+ users worldwide.
  • Mobility options: Mobility budget or company car (based on your job category).
  • Competitive compensation: Proactively maintained to value your work.
  • Net allowance: to support home office related expenses.
  • Vouchers: lunch vouchers & eco vouchers.
  • Comprehensive health insurance: Extensive coverage for you and your dependents.
  • Pension funding: Group insurance to secure your future.
  • Referral bonuses: Earn rewards for bringing in new talent.

About the company

At Lighthouse, we’re on a mission to revolutionize commercial strategy as hospitality’s most powerful AI platform. We take the world’s largest hotel data network and transform it into real-time intelligence that drives action. We don’t just deliver insights; we empower businesses to make decisions that move revenue.

With $370M in Series C funding and over $100M in ARR, we are scaling at lightspeed. Our 850+ teammates across 35 countries aren’t just building software-they are leveraging cutting-edge AI to help hoteliers be the first to act. Tens of thousands of hotels across 185 countries trust Lighthouse to execute their commercial strategy, including every one of the top 15 global chains and thousands of independent hotels that consistently outperform their markets. With Lighthouse AI, the intelligence gets deeper. Decisions get smarter. Actions get faster. We help hoteliers be first to act.

Lighthouse Values: Our guiding light

We are Lumineers. Our shared values keep us on a collaborative path fostering a cultural and customer centric environment

  • Pursuit of greatness: We’re innovators who care deeply about our customers’ success. Our team brings their best work, stays curious, and delivers excellence through attention to detail
  • Meaningful work matters: We make every moment count by knowing what to deliver, why it matters, and how it drives Lighthouse forward
  • Elevate each other: We don’t just work together - we grow together. What unites us is understanding each other as people and working toward shared goals

We’re more than just a workplace - we’re a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry’s most exciting rocket-ship?, The Crawler engineering team makes sure Lighthouse customers get fresh, high-quality rates, ranking and supply data. We handle close to 200 million requests a day across 200+ data sources, so the team carries a big responsibility for keeping our crawling infrastructure reliable, efficient and ahead of a web that keeps changing.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:47 min

Automating frontend performance metrics with Google Lighthouse

Miki Lombardi ¡ JS Congress

45 sec

Working securely with Node.js path application programming interfaces

Sonya Moisset ¡ World Congress 2023

2:59 min

Designing HTTP and HTML for familiar document sharing

Tim Berners-Lee ¡ World Congress 2023

1:22 min

Analyzing differences between mobile and traditional backend DevOps

Mete Baydar Mete Baydar ¡ World Congress 2025

3:55 min

Identifying underlying Node.js runtime vulnerabilities using fuzzing tools

Sonya Moisset ¡ World Congress 2023

5:02 min

Mapping distributed compute paradigms to modern vehicles

Joachim Werner ¡ LIVE

Videos

See all

Related articles

See all