Data Engineer
Role details
Job location
Tech stack
Job description
An experienced Data Engineer is required to support the CDW SA team in delivering DWIT Informatica Advanced Scans across Legacy data warehouses. This role is a key enabler for the strategic migration from Legacy data warehouses to the new Data Lakehouse architecture. The successful candidate will work closely with DWIT and CDW stakeholders to establish a comprehensive and accurate as is view of each Legacy warehouse, leveraging Informatica Advanced Scanning capabilities wherever possible., * Perform detailed analysis of Legacy data warehouses using Informatica Advanced Scanning techniques.
- Produce a complete and accurate as is representation of each data warehouse.
- Identify and document all inbound data feeds consumed by CDW, including:
- Source/origin systems
- Data formats
- Full feed by feed data content
- Capture and document the actual metadata held within the data warehouse, including:
- Table structures
- Field names and definitions
- Identify and document all outbound data feeds from the data warehouse, including:
- Consuming systems or platforms
- Full feed by feed data content
- Outbound metadata (tables, fields, and structures) Where possible, generate bespoke outputs from Informatica Advanced Scanning for each Legacy warehouse to support analysis and migration planning.
- Collaborate with architecture, data, and migration teams to ensure outputs are aligned to Data Lakehouse migration objectives.
- Ensure documentation is clear, accurate, and suitable for use in downstream migration and governance activities., * SA Profiles extracts
- SA MARTs
- SA Warehouse structures and concepts
- Caseflow and KBS
- Authorete
- Eureka
- Business Objects tooling:
- BO Infoview
- BO Developer
- BO CMC
- BO Import Wizard
Requirements
Strong experience with Unix Shell Scripting PL/SQL and Oracle SQL Maestro/TWS scheduling tools ETL concepts and implementations Command line tools (PuTTY/CLI) File transfer tools (eg WinSCP) Use of text and documentation tools (eg Notepad++, Word or equivalent), This role is hands on and delivery focused, supporting a critical phase of Legacy to Lakehouse migration. Strong attention to detail, documentation quality, and stakeholder collaboration are essential.
