Business Intelligence Data Engineer

The BI Data Engineer will support technical delivery across three focus areas: CRDM(Credit Risk Data Mart) lift-and-shift migration from SQL Server to Snowflake, tool modernization, and EDP (Enterprise Data Platform) adoption/repointing from on-prem SQL Server EDW tables to Snowflake EDW tables.

Role and Responsibilities:

• Responsible for designing and building data pipelines and Business Intelligence (BI) Solutions
• Data subject-matter expertise, or proven ability to identify and collaborate with the appropriate data SMEs. Works on complex projects/teams independently and acts as a mentor and leads other developers
• Design and develop BI solutions using Data Sources, calculated measures, and other transformations (lookups)
• Establish processes and automation for the enterprise-grade Data & BI platform
• Perform Data testing and Q&A - liaison between business, developers, and other technical teams
• Provide data and analytics support (i.e., SQL queries, SSAS, SAS, Alteryx workflows, Tableau, PowerBI reports and dashboards)
• Perform functional testing and data validation. Develop and execute testing plans, scenarios and validate data accuracy
• Test data services (data pipelines, APIs) that feed downstream requirements (Dashboards, Models, etc.) to ensure that the data is transferred correctly to the client application tools
• Strong experience with data lineage and data tracing
• Participate in user acceptance testing (UAT)
• Ensure client Security, Governance, Enterprise Architecture guidance and protocols are adhered
• Communicate progress, risks, and issues to the project team

Outcomes:

Following are some of the key deliverables expected from this role:

• Data & BI solutions include - data pipelines, ETLs, Cubes, reports, dashboards, etc.
• Test scripts and execution along with results
• Produce release notes/documentation
• Create documentation for change control
• Produce operational support documentation, source control repository management, and runbooks
• Provide end-user defect resolution and adoption support
• Other project documentation and artifacts as defined and assigned by Project Manager or clients Data & BI leadership

• Bachelor’s degree in Computer Science, Math, IT, Business or equivalent work or educational experience required.
• Minimum 7 years of experience in a related position working with data and BI solutions.
• Experience as Data/Business Intelligence Developer building scalable and robust solutions
• Experience leveraging AI tools to accelerate development while maintaining code quality and consistency. Snowflake AI Migration (AIM) tool / Cortex experience preferred
• Strong hands-on Snowflake experience, including:
• Converting SQL Server T-SQL processes and stored procedures to Snowflake.
• Translating SQL Server DDL objects to Snowflake.
• Designing and developing migration frameworks to programmatically move data from SQL Server to Snowflake.
• Data validation and reconciliation between source and target environments.
• Performance tuning and optimization of Snowflake workloads.
• Experience converting SSIS packages to Azure Data Factory (ADF) pipelines.
• Ability to establish and configure ADF environments for both Pre-Production and Production.
• Strong ETL design skills with emphasis on reusable, scalable pipeline frameworks.
• Experience with Apache Iceberg storage technology.
• Experience building and maintaining Azure DevOps (ADO) CI/CD release pipelines.
• Experience with source control and DevOps such as implementing and enhancing GitHub-based source control processes and tooling.
• Ability to improve repository management, branching strategies, and deployment workflows.
• Experience developing and maintaining SSAS cubes using Visual Studio.
• Experience migrating SSAS Cubes/Semantic Models to Power BI Semantic Models, including validation and performance optimization.
• Strong demonstrated experience acting as a business liaison and delivering both strategic and operational solutions to technical teams required.
• Experience owning, supporting and delivering the full data life cycle development and its various phases required.
• Knowledge of data manipulation languages and tools such as Python, Alteryx etc. preferred.
• Knowledge of business intelligence and data discovery tools such as Tableau, Alteryx or Power BI required.
• Understanding of data engineering vocabulary and data architecture. Includes experience working with Azure, DataOps, JIRA or other Agile development team tools required.
• Ability to plan, organize, schedule, and implement projects in accordance with established project management methodologies required.

Key Tools/Technologies:

• Data ingestion/ETL tools such as Azure Data Factory, SSIS, etc.
• SQL and other relational database concepts and languages
• Data warehouses, Data Lakes, and other data products such as Snowflake, Databricks, etc.
• Good understanding of SSIS and SSAS as a developer
• PowerBI
• SQL Server Management Studio
• Azure Synapse
• Advanced Excel, Word and Visio
• Finance/Fintech applications, systems, processes and best practices
• Expertise in source control management (ADO branching, merging, and release processes)
• Ability to use pivot tables based on data cubes
• Good to have experience with: Alteryx, Tableau and Python