Overview
Full Time
Contract - W2
Contract - Independent
Contract - 12
Skills
Spring
azure
API
Data Quality
collibra
Owl
Job Details
Position: Senior Data Quality Specialist (Collibra/Owl DQ)
Location: Manhattan, NY - 3 Days Onsite
Duration: Long Term
Location: Manhattan, NY - 3 Days Onsite
Duration: Long Term
Mandatory skill: 1. Collibra/Owl DQ 2. Data engineering
Additional skills: 1. API development with Spring boot
Description: We are seeing a Senior Data Engineer contractor with expertise in data quality and database management. The ideal candidate will have a strong background in data engineering, particularly with Azure technologies and will be responsible for ensuring the integrity and quality of our data assets.
Design, develop, and maintain data pipelines using Azure Data Factory and Databricks to support data integration and transformation processes.
Administer and manage database and application servers, ensuring optimal performance and security.
Implement and monitor data quality frameworks to ensure accuracy, completeness, and reliability of data across the organization.
Collaborate with cross-functional teams to understand data requirements and provide data solutions that meet business needs.
Support the integration of Collibra for data governance and stewardship, ensuring compliance with data management policies
Design, develop, and maintain data pipelines using Azure Data Factory and Databricks to support data integration and transformation processes.
Administer and manage database and application servers, ensuring optimal performance and security.
Implement and monitor data quality frameworks to ensure accuracy, completeness, and reliability of data across the organization.
Collaborate with cross-functional teams to understand data requirements and provide data solutions that meet business needs.
Support the integration of Collibra for data governance and stewardship, ensuring compliance with data management policies
Qualifications
8+ years of experience in data engineering, specifically with Azure Data Factory and Databricks.
Database/Application Server Administration
Data Quality Experience (Collibra/Owl DQ)
Hadoop Administration
Data Engineering on Azure (Azure Data Factory and Databricks)
Understanding of Collibra
Knowledge of Postgres and REST APIs
8+ years of experience in data engineering, specifically with Azure Data Factory and Databricks.
Database/Application Server Administration
Data Quality Experience (Collibra/Owl DQ)
Hadoop Administration
Data Engineering on Azure (Azure Data Factory and Databricks)
Understanding of Collibra
Knowledge of Postgres and REST APIs
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.