Senior Data Collect Engineer
Role details
Job location
Tech stack
Job description
As a Senior Data Collect Engineer you will join the Tech team and be actively involved in the design, development and maintenance of our high-performance, scalable collect systems.
-
Data Engineering (60-70%) Develop, maintain and optimize large-scale data collection functionalities in Java, Implement and maintain high-performance pipelines capable of handling millions of data points daily, Identify, analyse and adapt to website and API changes to ensure the continuity and reliability of daily data collection, Collaborate with the back-end and the product teams to guarantee seamless system integration, Provide clear and comprehensive technical documentation for developed solutions.
-
Scraping (10-20%) Detect website structural changes, anti-scraping patterns and blockers, and implement strategies to adjust crawlers accordingly, Contribute to improving scraping methods and tools to increase reliability, bypass obstacles, and reduce maintenance overhead.
-
Infrastructure / Ops (10-20%) Configure, maintain and optimize the Puma application server to ensure high availability and optimal performance, Administrate the technical ecosystem required for Java developments, Participate in performance management and resolving complex technical incidents ., Java 11/21 MySQL Elasticsearch Pub/Sub queuing Notion (documentation & processes) Slack Google Workspace, Must-haves, You can be based anywhere in Europe. Full flexibility: full remote work with European hubs and 400+ coworking spaces worldwide. Monthly and quarterly highlights in person to get together with other Kolsquarians for great team-building events. A package linked to the market that will not be based on your location. The stability and resources of a profitable group, with the agility of a scale-up. Continuous training opportunities and career development support.
Requirements
Do you have experience in Spring Boot?, A strong experience in a data collect engineer position - at least 5 years' experience, ideally in fast-paced scale-ups or SaaS/tech environments. A strong expertise in Java 11+ and the Java eco system: springboot, maven, jenkins, nexus. Comfortable in English! Kolsquare is an international company. MySQL skills and analytical skills for big data performance. Knowledge of versioning tools (Git), on http protocol, Elasticsearch, and cloud providers. You want to join an adventure more than a job! Kolsquare is a benefit company, with a general interest ambition that goes beyond our profitability goals: positively impact the world., Appetite for reverse engineering. You are curious and want to learn, improve and gain responsibility. Experience leading a team.