Backend Developer GO - Goland H/F
Role details
Job location
Tech stack
Job description
As a member of the back-end team, you will:
- Be a full-time member of a squad
- Maintain processing pipelines of80 M documents ingested per day and 100 billion in storage
- Design solutions for squad projects, in collaboration with the product owner and the other back-end/front-end/machine-learning developers of the squad
- Develop and implement these projects
- Define milestones for project implementation and deployment
- Evolve and maintain the tools and libraries shared by the back-end team
Our back-end stack: Go, Python, JS, React, MySQL, Elasticsearch, Cassandra, Kafka, Gitlab, Docker, Ansible.
Our platform uses a microservice architecture containing 200+ microservices, most of them written in Go and using Kafka or HTTP to communicate.
The hardware infrastructure is composed of hundreds of rented bare metal servers running Debian. A big part of it is dedicated to storage, including:
1 PB+ Elasticsearch, 750TB+ MySQL clusters, 150 TB+ Scylla DB, and 250TB+ of Kafka.
Example projects we've worked on:
- Add vector search capabilities.
- Data usage tracking to enable cost monitoring and tailored billing.
- Implement new crawlers to retrieve documents from more diverse sources.
- Revamp of the alerting system for increased stability and additional functionalities.
- Custom AI enrichments for clients to further personalize their experience and usage.
Requirements
Profil recherché Preferred Experience:Experience with complex microservice architecture is preferredKnowledge of Golang is beneficial but not requiredInterest in system performance and robustnessPrior experience with very large amounts of data, message queues and high-throughput processingSoft Skills:Rigor and strong appetite for software qualityInterest in manipulating dozens of microservices in data processing pipelines handling billions of documentsCuriosity and passion to discuss the consequences of a design choiceGood communicator, self-starter, and collaborative enthusiastInterested in understanding user needsIndependent, self-organizing, and able to prioritize multiple complex assignmentsRepresent the organization and advocate its technological efforts and capabilities using external presentations and publicationsInterested in multicultural companiesFluent in French and English in writing, speaking, and reading, Preferred Experience:
- Experience with complex microservice architecture is preferred
- Knowledge of Golang is beneficial but not required
- Interest in system performance and robustness
- Prior experience with very large amounts of data, message queues and high-throughput processing
Soft Skills:
- Rigor and strong appetite for software quality
- Interest in manipulating dozens of microservices in data processing pipelines handling billions of documents
- Curiosity and passion to discuss the consequences of a design choice
- Good communicator, self-starter, and collaborative enthusiast
- Interested in understanding user needs
- Independent, self-organizing, and able to prioritize multiple complex assignments
- Represent the organization and advocate its technological efforts and capabilities using external presentations and publications