Big data Lead

Here Technologies
Chicago, United States of America
18 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Chicago, United States of America

Tech stack

API
Profiling
ETL
Data Mapping
Data Transformation
Data Profiling
JSON
SQL Databases
Data Streaming
Openapi
Snowflake
Data Layers
Data Lineage
REST
Programming Languages

Job description

Work closely with business stakeholders to gather, validate, and clarify data and reporting requirements.

Translate business needs into detailed functional and technical requirement documents.

Develop comprehensive Source-to-Target Mapping (STTM/STM) documents capturing field-level data logic.

Create detailed Business Rules, Data Definitions, and Data Transformation documentation.

Perform complete data lineage analysis across Snowflake, APIs, upstream sources, and reporting layers.

Assist in data modeling and design aligned with Medallion architecture (Bronze/Silver/Gold layer separation).

Conduct data profiling, validation, and reconciliation using Snowflake SQL.

Work with REST API data integrations, including reading API specifications, understanding payloads, and mapping to Snowflake tables.

Collaborate with data engineers, ETL/ELT developers, and QA to ensure accurate interpretation of the requirements.

Support UAT and resolve data-related gaps through iterative testing and validation.

Requirements

Proven experience with programming languages such as SQL and Python for data validation, profiling, reconciliation, and analytics.

Strong hands-on Snowflake experience is required, including: o Ability to construct & optimize complex SQL queries o Variant/JSON parsing o Schema and stage understanding o Performance analysis & troubleshooting

Working experience in Medallion Architecture (Bronze, Silver, Gold data layers) including mapping data flows across layers.

Apply for this position