Data Engineer
Role details
Job location
Tech stack
Job description
- Design, develop, test and maintain data architecture across multiple application platforms.
- Build, optimise and operationalise ETL/ELT data pipelines across structured and unstructured data sources.
- Develop and maintain data integration solutions and APIs.
- Manage data ingestion, transformation and delivery pipelines into production environments.
- Support data accessibility, optimisation and downstream data consumption.
- Define and support conceptual, logical and physical data models to meet business and analytics requirements.
- Ensure data integrity, accuracy and consistency across systems.
- Implement data quality controls, traceability and versioning processes.
- Perform root cause analysis and support continuous optimisation of data processes.
- Support data migration activities across databases, systems and environments.
- Define and implement scalable data storage solutions and architectures.
- Identify opportunities for process improvement, automation and reduced manual intervention.
- Work closely with business, analytics and technology stakeholders to understand requirements and deliver practical solutions.
- Produce clear technical documentation, solution design artefacts and process documentation.
- Support knowledge transfer to internal and client teams.
- Provide regular progress updates, including risks, assumptions, issues and dependencies.
- Work in line with agreed architecture, governance, data protection, security and risk requirements.
Requirements
Do you have experience in Data management?, Do you have a Bachelor's degree?, This role would suit a highly capable Data Engineer with strong experience in designing, building, operationalising and supporting scalable data pipelines, data stores and integration solutions. The successful candidate will be comfortable working in a structured client environment, communicating clearly with stakeholders, producing high-quality documentation and taking ownership of technical delivery.
You will need strong written and verbal communication skills, be self-motivated, organised and able to manage your own work schedule. You should be confident working with business, analytics and technology teams to translate requirements into practical, reliable and well-documented data solutions., * Significant experience in data engineering or a closely related discipline.
- Strong experience building and optimising data pipelines, data architectures and data sets.
- Experience with data integration, warehousing and reporting solutions.
- Strong database programming experience, particularly SQL.
- Experience with ETL/ELT tools, processes and best practice.
- Experience developing APIs and system integration solutions.
- Good understanding of the data lifecycle, integration patterns and system design.
- Experience working with data quality, data integrity, traceability and governance requirements.
- Ability to write clear technical documentation and communicate technical concepts effectively.
- Strong analytical and problem-solving skills.
- Excellent attention to detail and a quality-focused approach.
- Ability to work independently while collaborating effectively with wider project teams.
- Strong stakeholder management skills within IT or data-led environments., * Experience working in financial services, banking, regulated environments or enterprise IT environments.
- Experience with cloud-based or big data environments, including AWS or similar platforms.
- Experience with Spark, PL/SQL or similar database / data engineering technologies.
- Experience with big data frameworks and pipeline orchestration tools.
- Experience supporting production data platforms and monitoring pipeline performance.
- Experience contributing to data standards, governance processes or best practice documentation.
- Experience working in Agile or structured delivery environments., * A relevant Bachelor's Degree or equivalent professional qualification / experience in one or more of the following areas would be preferred:
- Information Technology
- Data Management
- Data Science
- Business Analytics
- Computer Science
- A related technical discipline
WHAT WE ARE LOOKING FOR
We are looking for someone who is technically strong, reliable, practical and professional.
The successful candidate should be able to take ownership of data engineering tasks, work to agreed priorities, communicate clearly with stakeholders and produce work to the high standards our clients expect.
This role requires someone who can combine strong technical delivery with clear documentation, good judgement and professional communication., * Data Engineering: 5 years (preferred)
Benefits & conditions
Pulled from the full job description
- Referral programme
- Company pension
- Private medical insurance
- Casual dress
- Work from home
- Company events, Competitive salary or day rate, based on experience.
Flexible remote working.
Opportunity to work on a long-term client engagement.
Potential to move into a permanent role with Agile Automations.
Support from an experienced Agile Automations delivery team.
Opportunity to work in a professional, regulated client environment.
Training, support and career development opportunities where appropriate., Job Types: Full-time, Contract, Permanent Contract length: 12 months
Pay: From £40,000.00 per year
Benefits:
- Casual dress
- Company events
- Company pension
- Private medical insurance
- Referral programme
- Work from home