Data DevOps
Xquisit
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Tech stack
Backup Devices
Databases
Continuous Delivery
Continuous Integration
Data Structures
Relational Databases
DevOps
Elasticsearch
Graph Database
Python
PostgreSQL
Message Broker
Enterprise Messaging Systems
Microsoft SQL Server
Neo4j
Openshift
Scrum
RabbitMQ
SQL Stored Procedures
Systems Integration
Management of Software Versions
Data Logging
Scripting (Bash/Python/Go/Ruby)
Backend
Gitlab
GIT
Database Migration
Git Flow
Kubernetes
Information Technology
Kafka
Non-relational Database
Software Version Control
Job description
The client is looking for a Data DevOps. You will primarily be responsible for maintaining existing systems while deploying new database technologies, some of which will be specifically dedicated to data mining using artificial intelligence. For certain cross-functional application projects involving relational databases, you will be the point of contact for aspects related to their performance and security.
Main Duties:
- During the first phase of your assignment, you will be required to:
- Understand the existing systems and familiarize yourself with the different environments
- Participate in the maintenance and development of current database systems. These are mainly relational (PostgreSQL) and non-relational (Elastic Search) databases. For some of them, such as those dedicated to R&D projects, it may be necessary to implement automated backup procedures (which already exist for others).
- Provide support to the development teams responsible for maintaining legacy software. Due to the DB First approach used in these projects, it is necessary to call upon a database expert profile, primarily for aspects relating to data structure migrations and the replacement of stored procedures with backend functionalities.
- Participate in the maintenance and integration of a centralized logging platform for application projects. This platform is based on Kafka.
- During the second phase of your assignment:
- You will continue your maintenance activities on the solutions described previously.
- You will participate in the development of a solution widely deployed for managing investigations and drafting reports. In this context, you will be involved in aspects related to improving performance and security.
- You will also be involved in continuous integration and continuous deployment (CI/CD). Deployments are carried out on both traditional servers and container orchestrators such as Kubernetes or OpenShift.
- You will participate in setting up environments for specialized databases, such as Graph DB (Neo4j) and Vector DB (Milvus), to support Data department projects.
- You will implement or maintain automated processes, particularly for managing migrations and backups.
- You will work in an agile mode, focusing on planned tasks and meeting established deadlines.
Requirements
- You hold a bachelor's degree in computer science (minimum) and have several years of experience in a similar role.
- You are a Confirmed Data Base Administrator.
- You have solid knowledge of relational (PostgreSQL) and non-relational (Elasticsearch) databases.
- You are able to install and industrialize this type of environment, particularly through scripting and development in Python.
- You have a good understanding of distributed messaging systems (Kafka) and are able to ensure their maintenance and industrialization.
- You have expertise in database migration, and working closely with developers using a code-first approach is natural for you.
- You have knowledge of Graph DB (Neo4j) and Vector DB (Milvus), or are willing to acquire it quickly to contribute to the implementation of these platforms.
- You are able to participate in the modeling of data structures and implement standardization across the various systems used in projects.
- You are also proficient in the Git versioning platform and the strategies to be applied in terms of branch management.
- Knowledge and experience in DevOps, CI/CD, GitOps, GitLab, and Kubernetes cluster management are also desirable.
- You are accustomed to working in an agile environment, using the Scrum methodology, and are able to adapt quickly to a change in technical direction during a project, or even to a technology you are not yet familiar with.
- Persevering and solution-oriented, you integrate easily into a team composed of diverse backgrounds.
- English: active knowledge
Technologies:
- Relational Databases: PostgreSQL (Must have), MS SQL (Nice to have)
- Non-Relational Databases: Elastic Search (Must have)
- Distributed Messaging System: Kafka (Must have)
- Version Control: GIT (Must have)
- Devops: Gitlab, CI/CD, GitOps, Kubernetes, MinIO, Python Scripting (Should have)
- Graph Databases: NEO4J (Nice to have)
- Vector Databases: Milvus (Nice to have)
- Message Broker: Rabbit MQ (Nice to have)
Soft Skills:
- Adaptability: Ability to adapt to changes in technology or strategy
- Perseverance: Not giving up at the slightest difficulty
- Team Spirit: Integrating into the team's vision and thinking collectively
- Autonomy: Ability to work alone once things are aligned with the team
- Technical Curiosity: Not staying Confined to things we know
- Creativity: Thinking outside the box to propose original solutions
- Solution-oriented: Detecting problems but, above all, proposing solutions
- Ease of integration: Fitting easily into a new environment
- Communication: Knowing how to communicate easily and as soon as necessary