Big data Lead
Location : Cook, IL (5 days onsite)
Fulltime Role
Work closely with business stakeholders to gather, validate, and clarify data and reporting requirements.
Translate business needs into detailed functional and technical requirement documents.
Develop comprehensive Source-to-Target Mapping (STTM/STM) documents capturing field-level data logic.
Create detailed Business Rules, Data Definitions, and Data Transformation documentation.
Perform complete data lineage analysis across Snowflake, APIs, upstream sources, and reporting layers.
Assist in data modeling and design aligned with Medallion architecture (Bronze/Silver/Gold layer separation).
Conduct data profiling, validation, and reconciliation using Snowflake SQL.
Work with REST API data integrations, including reading API specifications, understanding payloads, and mapping to Snowflake tables.
Collaborate with data engineers, ETL/ELT developers, and QA to ensure accurate interpretation of the requirements.
Support UAT and resolve data-related gaps through iterative testing and validation.
Mentor and guide more junior team members.
Skills
Proven experience with programming languages such as SQL and Python for data validation, profiling, reconciliation, and analytics.
Strong hands-on Snowflake experience is required, including: o Ability to construct & optimize complex SQL queries o Variant/JSON parsing o Schema and stage understanding o Performance analysis & troubleshooting
Working experience in Medallion Architecture (Bronze, Silver, Gold data layers) including mapping data flows across layers.
Proven experience with API-based data ingestion (REST APIs, JSON/XML nice to have