Senior Data Acquisition R&D EngineerNew

You will join us as a Senior Data Acquisition R&D Engineer, playing a critical role in our data extraction process. With a deep interest for the inner workings of the internet, you will ensure we can reliably extract and process billions of data points every day. You will be a key technical expert, pushing the boundaries of our capabilities and mentoring team members. This role is perfect for someone who loves solving complex technical puzzles and wants to share their passion with the team.

Where you will have impact

• Drive the research and development of advanced techniques for web data extraction and processing at scale.
• Leverage your expertise in reverse engineering and browser technologies to push the boundaries of our data acquisition capabilities.
• Tackle complex web scraping challenges, including user agent emulation, cost-efficient proxy utilisation, and effective load distribution.
• Act as a subject matter expert, providing mentorship and support to team members while fostering an environment of continuous learning.
• Collaborate with diverse engineering teams to address challenges and advance initiatives related to data extraction and infrastructure.
• Contribute to our data extraction infrastructure, ensuring it remains scalable, reliable, and robust.

About our team

Our team is at the helm of our sophisticated data extraction infrastructure. Tasked with the responsibility of acquiring pricing data from over 200 unique data sources, we process nearly 200 million requests each day. The data we collect is the lifeblood of our products. We are committed to ensuring its reliable and timely delivery, thereby powering our diverse product portfolio.

Do you have experience in TypeScript?, * Multiple years of experience in at least one of the following areas: networking protocols, browser development, reverse engineering websites or mobile applications, or anti-bot technology.

• Proficiency in at least one modern programming language.
• Strong problem-solving and analytical skills, with the ability to identify and troubleshoot complex technical issues.
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• Fluency in English.

We welcome

• Experience or a strong interest in mentoring colleagues on technical topics.
• A proven track record of technical excellence, such as open-source contributions, technical articles, or conference talks.
• A keen interest in web security and its application to data acquisition.

Technologies you will work with

Google Cloud, Kubernetes, NodeJS, TypeScript, Scrapy, Python, Rust, Prometheus, Grafana

What's in it for you?

• Flexible working environment: Work from home or at one of our global offices.
• Flexible time off: Autonomy to manage your work-life balance.
• Collaborative team: High-bar, friendly, creative, and passionate colleagues.
• Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
• Impactful work: Shape products relied on by 75,000+ users worldwide.
• Mobility options: Mobility budget or company car tailored to your needs.
• Comprehensive health insurance: Extensive coverage for you and your dependents.
• Private pension funding: Group insurance to secure your future.
• Competitive compensation: Proactively maintained to value your work.
• Referral bonuses: Earn rewards for bringing in new talent.

At Lighthouse, we're on a mission to disrupt commercial strategy for the hospitality industry. Our innovative commercial platform takes the complexity out of data, empowering businesses with actionable insights, advanced pricing tools, and cutting-edge business intelligence to unlock their full revenue potential. Backed by $370 million in series C funding and driven by an unwavering passion for growth, we've welcomed five companies into our journey and have surpassed $100 million in ARR in 2024. Our 850+ teammates span 35 countries and represent 34 nationalities. At Lighthouse, we're more than just a workplace - we're a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry's most exciting rocket-ship?, Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. We actively encourage applications from individuals with disabilities and are dedicated to providing reasonable accommodations throughout the recruitment process and during employment to ensure all qualified candidates can participate fully. Our commitment to equality is not just a policy; it's part of our culture. If you share our passion for innovation and teamwork, we invite you to join us in shaping the future of the hospitality industry. At Lighthouse, our guiding light is to be an equal opportunity employer, and we encourage individuals from all walks of life to apply. Not ticking every box? No problem! We value diverse backgrounds and unique skill sets. If your experience looks a little different from what we've described, but you're passionate about what we do and are a quick learner, we'd love to hear from you. We value the unique perspective and talents that you bring, and we're excited to see how your light can shine within our team. We can't wait to meet you and explore how we can grow and succeed together, illuminating the path towards a brighter future for the industry. #LI-Hybrid   You must create an Indeed account before continuing to the company website to apply