Data Engineer
Role details
Job location
Tech stack
Job description
Requirements definition and management
- Defines and manages scoping, requirements definition and prioritisation activities for initiatives of medium size and complexity.
- Contributes to selecting the requirements approach.
- Facilitates input from stakeholders, provides constructive challenge and enables effective prioritisation of requirements.
- Establishes requirements baselines, obtains formal agreement to requirements, and ensures traceability to source.
Database design
- Implements physical database designs to support analytical data requirements for performance and availability.
- Develops and maintains specialist knowledge of database and data warehouse concepts, design principles, architectures, software and facilities.
- Assesses proposed changes to object/data structures and evaluates alternative options.
- Implements data warehouse designs that support demands for business intelligence and data analytics.
Data engineering
- Designs, implements, and maintains complex data engineering solutions to acquire and prepare data.
- Creates and maintains data pipelines to connect data within and between data stores, applications and organisations.
- Carries out complex data quality checking and remediation.
Data modelling and design
- Investigates enterprise data requirements where there is some complexity and ambiguity.
- Plans own data modelling and design activities, selecting appropriate techniques and the correct level of detail for meeting assigned objectives.
- Provides advice and guidance to others using the data structures and associated components.
Change control
- Assesses, analyses, develops, documents and implements changes based on requests for change.
- Ensures that operational processes are in place for effective change control.
- Develops, configures and maintains tools to manage and report on the lifecycle of change requests.
- Identifies problems and issues and recommend corrective actions.
Release and deployment
- Assesses and analyses release components for input to release scheduling.
- Maintains and administers tools and methods for software delivery, deployment and configuration.
- Maintains release processes and procedures.
Risk and compliance
- Ensure that all Governance and Compliance requirements are adhered to and all reporting and reviewing activities required by the Regulatory Bodies are carried out to the standards required.
Requirements
-
Oracle experience beneficial
-
Snowflake experience
-
Experience Working with Data teams
-
IDMC, Kafka data sources.
-
Understanding of Data Architecture patterns/Data lakes/kimbol
-
Practical experience of Platforms
-
Cloud platforms structuring Data
-
Relational database
-
Snowflake going through the cloud platform
-
Informatica experience
-
Change data capture experience
-
Working with various data formats is essential
-
Involved in end-to-end data delivery working with the business and requirements and rolling out into production, * Works without the need for close supervision, showing excellent time management and organisational skills, delivering to agreed timescales
-
Approaches problems systematically and objectively, analyses facts and evaluates options, draws sound conclusions
-
Builds long lasting relationships with both internal and external customers
-
Collaborates openly and effectively across functions to deliver change
-
Possesses an excellent attention to detail
-
Remains focused and calm under pressure
-
Presents insight to and communicates effectively with a range of stakeholders including senior management
-
Plans well and is able to balance multiple priorities and deal with ambiguity
-
Role models a genuine drive for improvement and encourages others to drive for excellence
-
Demonstrates a high level of creativity, drive, innovation and initiative; a self-starter with a constant desire to learn
-
A good understanding of how to query data from relational databases using SQL
-
Competent in the use of Oracle/ PL/QL/ SQL and Oracle Apex
-
Experience of implementing various data platform architectures, data lakes and data warehouses
-
Ability to translate business goals / pain points into data products that drive value
-
Previous experience working in a business intelligence / analytics environment
Desirable
- Identifies dependencies and risks across multiple projects / delivery streams
- Experience of implementing and supporting cloud data platforms such as Snowflake
- Knowledge and experience of working in an Agile way
- Financial services domain knowledge