Data Engineer

7IM LLP
London, UK
about 1 month ago
Apply on uk.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Data Analysis Microsoft Azure Big Data Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Transformation Data Security Data Systems Data Vault Modeling Data Warehousing
+17 more
Python (Programming Language) Microsoft Servers Microsoft SQL Server Power BI Azure Data Lake Reverse Engineering Systems Integration Azure Data Factory Technical Debt Togaf Data Lakes Pyspark Tools for Reporting Software Version Control Data Pipelines Serverless Computing Databricks

Job description

Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data platform, tools and processes., * Build robust and scalable data solutions that meet technical and security standards

  • Contribute to the design of data solutions in line with the architecture and roadmap
  • Design, develop, test and release robust, scalable software solutions using modern technologies and best practices
  • Develop and maintain data models, pipelines and documentation
  • Adhere to engineering standards and help keep technical debt in check
  • Collaborate with business stakeholders and technical teams to analyse needs, propose solutions and ensure alignment
  • Contribute to initiatives that modernise technology, tools and development processes
  • Peer review code and documentation for accuracy, maintainability and supportability
  • Provide second-line support and guidance to application support teams
  • Identify opportunities for technical efficiencies and share best practice
  • Ensure compliance with regulatory standards and internal policies
  • Other duties as reasonably required by line management and 7IM

Requirements

  • Experience in a data engineering role, ideally within a regulated environment
  • Knowledge of the following is required:

  • Modern Data platform concepts; Data Lake, Lakehouse, Data Warehouse, Data Vault
  • Azure Data Technologies; Azure Data Lake Storage, Azure Data Factory, Azure Databricks, MS Fabric
  • ETL / ELT processes and designing, building and testing data pipelines
  • Building data transformations using Python /PySpark
  • Azure Cloud Version control and CI/CD tools, specifically Azure DevOps Service
  • Analytics and MI products including MS Power BI
  • Data catalogue & governance using MS Purview

  • Knowledge of the following would be desirable:

  • Microsoft server-based data products (SQL Server, Analysis Services, Integration Services and Reporting Services)
  • Enterprise Architecture tools (e.g. LeanIX, Ardoq), Frameworks (TOGAF) and core artefacts (Capability Models, Technical Reference Models, Data Flow Diagrams

  • Experience developing and implementing technology roadmaps and target state architectures
  • Experience integrating bespoke software, commercial off-the-shelf packages and third-party services
  • Demonstrable experience of migrating on-premises workloads to cloud-native services
  • Excellent analytical, problem-solving and communication skills
  • Strong stakeholder management and influencing abilities at all levels
  • Commitment to continuous learning and keeping skills current

Skills

  • Able to work independently within the data space and comfortable dealing with some ambiguity
  • Comfortable delivering to plan in a fast-paced environment
  • Excellent verbal and written communication with a proven track record of stakeholder engagement and influencing both business and technical stakeholders
  • Ability to communicate between the technical and non-technical - interpreting the needs of technical and business stakeholders, communicating how activities meet strategic goals and client needs
  • Ability to analyse data to drive efficiency and optimisation, design processes and tools to monitor production systems and data accuracy
  • Ability to produce, compare, and align different data models across multiple subject areas, reverse-engineering data models from a live system where required
  • Excellent analytical and numerical skills are essential, enabling easy interpretation and analysis of large volumes of data
  • Excellent problem-solving and data modelling skills (logical, physical, semantic and integration models), * Relevant degree or equivalent experience.
  • Azure DP-203 (or equivalent)
  • Certification in Data Governance and Stewardship Professional (DGSP) or similar (desirable).
  • Evidence of business experience or formal business qualifications (desirable).

Other relevant information

  • Experience of wealth management (including operational knowledge) would be advantageous
  • Prior experience working in Financial Services preferred thorough understanding of data security, data privacy, and GDPR required

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on uk.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all