Software Engineer
Role details
Job location
Tech stack
Job description
Co-Founder @ Digital Waffle - The go-to partner when scaling your team within Tech, Digital, Marketing & Data - without the usual bullsh*t.
This role suits someone who has worked with web scraping, crawling, and automation frameworks, and who enjoys solving complex technical challenges around speed, reliability, and scale.
About the Company
An ambitious and fast scaling digital business that depends on reliable real time data collection to support commercial decision making. The team works with high volume traffic, fast moving datasets, and automation systems that need to remain robust and flexible as requirements evolve. What You Will Be Doing
- Building and maintaining automated web crawlers that collect structured data at scale.
- Integrating third party captcha solving APIs in a compliant way when required.
- Designing resilient systems to avoid rate limit issues and maximise success rates.
- Monitoring crawler performance and implementing fixes for reliability and speed.
- Working closely with product and engineering teams to refine data requirements.
- Ensuring all automation work is compliant with legal, ethical, and platform guidelines.
Requirements
- Strong experience with Python, Node.js, or Go.
- Experience working with web scraping libraries and proxies.
- Knowledge of captcha solving APIs and challenges around automated form handling.
- Familiarity with queue systems, distributed crawling, and scaling automation tools.
- A problem solving mindset with strong attention to detail.
- Ability to optimise scripts for stability and volume.