Data Engineer
Experis
Edinburgh, United Kingdom
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Intermediate Compensation
£ 18KJob location
Edinburgh, United Kingdom
Tech stack
Big Data
Cloud Computing
Cloud Engineering
Elasticsearch
Logstash
Data Streaming
Data Ingestion
Data Management
Kibana
Job description
- As a Cloud Engineer with an ELK SME extension, you will be responsible for maintaining and managing our Elastic stacks. This includes configuring large Elastic clusters and ensuring optimal performance through effective tuning and management. You will work closely with large data sets, leveraging your expertise in elastic indexing best practices. Additionally, you will design and implement data ingestion pipelines using Logstash, ensuring data flows are efficient and effective.
Technologies:
- Big Data
- Cloud
- ELK
- ElasticSearch
- Kibana
Requirements
- 5 Years UK Residency - BPSS and OPSEC
- Professional experience in the design, maintenance, and management of Elastic stacks (Elasticsearch, Logstash, Kibana)
- Minimum of 2 years of experience as an ELK SME
- Experience configuring and maintaining large Elastic clusters
- Experience working with large data sets and elastic indexing best practices
- Good understanding of visualization components and techniques in Elasticsearch
- Proven experience in performance management and tuning of Elasticsearch environments
- Strong experience in writing data ingestion pipelines using Logstash and other big data tools
