Data Analyst Course Programme
Role details
Job location
Tech stack
Job description
- Serve as on-call escalation for data pipeline incidents, including real-time stream failures and batch job errors.
- Rapidly analyze logs, metrics, and trace data to pinpoint failure points across AWS, Flink, Kafka, and Python layers.
- Lead post-incident reviews: identify root causes, document findings, and drive corrective actions to closure.
Reliability & Monitoring
- Design, implement, and maintain robust observability for data pipelines: dashboards, alerts, distributed tracing.
- Define SLOs/SLIs for data freshness, throughput, and error rates; continuously monitor and optimize.
- Automate capacity planning, scaling policies, and disaster-recovery drills for stream and batch environments.
Architecture & Automation
- Collaborate with data engineering and product teams to architect scalable, fault-tolerant pipelines using AWS services (e.g., Step Functions, EMR, Lambda, Redshift) integrated with Apache Flink and Kafka.
- Troubleshoot & Maintain Python-based applications.
- Harden CI/CD for data jobs: implement automated testing of data schemas, versioned Flink jobs, and migration scripts.
Performance Optimization
- Profile and tune streaming jobs: optimize checkpoint intervals, state backends, and parallelism settings in Flink.
- Analyze Kafka cluster health: tune broker configurations, partition strategies, and retention policies to meet SLAs.
- Leverage Python profiling and vectorized libraries to streamline batch analytics and report generation.
Collaboration & Knowledge Sharing
- Act as SME for data & reporting stack: mentor peers, lead brown-bag sessions on best practices.
- Contribute to runbooks, design docs, and on-call playbooks detailing common failure modes and recovery steps.
- Work cross-functionally with DevOps, Security, and Product teams to align reliability goals and incident response workflows.
Benefits
- Enhanced leave - 38 days inclusive of 8 UK Public Holidays
- Private Health Care including family cover
- Life Assurance - 5x salary
- Flexible working-work from home and/or in our London Office
- Employee Assistance Program
- Company Pension (Salary Sacrifice options available)
- Access to training and development
- Buy and Sell holiday scheme
- The opportunity for "work from anywhere/global mobility", BA with Consumer Credit Reporting Data Location- London Rate- Open (Inside IR35) Contract- 6 months extendable Note: CV should have clear mention of Consumer credit reporting in their projects Please note few of the Key points to source Profiles : * Client is looking..., A recruitment agency is looking for an Exams and Management Information Systems (MIS) Officer in North London. This temporary position offers £18.92 per hour PAYE, and tasks include managing exam entries, amendments, and withdrawals while ensuring deadlines are met. The..., Join us as a PostgreSQL SRE at Barclays where you'll effectively monitor and maintain the bank's critical technology infrastructure and resolve more complex technical issues, whilst minimizing disruption to operations. In this role you will assume a key technical leadership..., A public service organization in Haringey, London is seeking a detail-oriented Exams and Management Information Systems Officer. This role involves coordinating examinations, maintaining accurate student records, and providing management information to enhance..., About the role We're looking for a Senior Software Engineer with strong development skills and hands-on SRE experience to join our London-based team. You'll help shape the future of reliability and observability at Forter, ensuring we can build and run scalable, reliable...
Requirements
We are seeking an experienced Site Reliability Engineer (SRE) with deep subject-matter expertise in data processing and reporting. In this role, you will own the reliability, performance, and operational excellence of our real-time and batch data pipelines built on AWS, Apache Flink, Kafka, and Python. You'll act as the first line of defense for data-related incidents, rapidly diagnose root causes, and implement resilient solutions that keep critical reporting systems up and running.
Benefits & conditions
Job Description Data Operations Analyst - Financial Services (Contract) Location: 100 Liverpool Street, London (Hybrid - 2-3 days onsite) Contract: 6 months (extension possible) Day Rate: £250-£310 per day About the Role We are looking for a data-focused professional...