Data Engineer - Senior Analyst
Opus Recruitment Solutions
Newcastle upon Tyne, United Kingdom
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.reed.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£35,000 - £55,000
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Artificial Intelligence
Amazon Web Services
Data Analysis
Microsoft Azure
Continuous Integration
Data Governance
Extract Transform Load (ETL)
Data Systems
Data Warehousing
Github
Python (Programming Language)
+13 more
Cloud Services
SQL Databases
Data Streaming
Apache Spark
Kubernetes
Infrastructure Automation Frameworks
Apache Flink
Apache Kafka
Terraform
Data Pipelines
AWS EKS
Docker
Jenkins
Job description
- Build and optimise data pipelines using Java (preferred) or Python.
- Develop real-time streaming and batch data pipelines.
- Work with Kafka, Flink or Spark, with Kafka/Flink preferred.
- Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
- Implement data governance, lineage, security and quality controls.
- Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
- Use Terraform and Infrastructure as Code practices.
- Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
- Collaborate with analytics, AI/ML, product and engineering teams.
Requirements
- Amazon Web Services (AWS)
- Cloud Services & Infrastructure
- Communication Skills
- Data Pipeline Development
- Data Warehousing
- ETL
- Microsoft Azure
- Python Programming
- SQL Databases
- Stakeholder Management
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.reed.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…