Collibra Developer / Data Governance

Collibra Developer - Data Governance

Rate: Open - C2C

LOCATION: Chicago, IL

HYBRID 3 DAYS ONSITE

SELLING POINTS: develop metadata data lineage data quality for on prem and cloud aws kafka develop custom metadata connectors scanners using python collibra connector workflows 6 years data analysis collibra dip dq tools sql python data governance collibra data catalog data quality bpmn groovy scrpting

1. WORK TO BE PERFORMED:

• Develop Metadata, Data Lineage and Data Quality Solutions for multiple data sources across On Prem and Cloud environments including but not limited to Kafka, Protocol Buffers, REDIS, APIs, Databases, Flat Files, JSON, ETL/BI Tools and other Data Platform technologies etc.

• Develop custom metadata connectors/scanners using Python, Collibra connectors and workflows to automate metadata harvest and import in Collibra Data Intelligence Platform.
• Design and Develop Collibra Workflows leveraging Collibra REST APIs to automate various data governance tasks and processes.
• Design, Build and Execute Data Quality Rules over the critical data elements (CDEs) identified according to the business needs to ensure clean and healthy data.
• Manage Data Quality Exceptions and help the team to find out the root cause analysis.
• Create Source to Target mapping documents reverse engineering the application Java code/SQL queries for the identified data flows to implement end-to-end data lineage.
• Design and build data capabilities - data quality, metadata, data catalog and data dictionary.

1. SKILL AND EXPERIENCE REQUIRED:

• 6 or more years of data analysis, Collibra DIP and DQ tool experience with robust understanding of metadata, data quality, data flows and data lineage mappings.
• Proficient with SQL and Python.
• Handson experience with Data Governance tools - Collibra Data Catalog (DIP) and Collibra Data Quality.
• Proficient configure and customize Collibra workflows using BPMN and Groovy scripting.
• Hands-on experience integrating and developing solutions using Collibra REST APIs.
• Ability to develop and implement Data Quality Solutions for multiple data sources across On Prem and Cloud environments including but not limited to Databases, Flat Files, JSON, APIs, Kafka etc.
• Experience working on Protobuf, APIs, Kafka as Data Sources is preferred.
• Experience working with various types of databases like Relational, NoSQL, Object-based.
• Ability to multitask and meet aggressive deadlines efficiently and effectively.
• Ability to work effectively in a fast-paced environment with evolving priorities.