Overview
On Site
Contract - Independent
Contract - W2
Contract - Long Term
Skills
Databricks
Data Engineer
Azure Data Factory
Collibra
Job Details
Senior Data Quality Specialist
Location: New York, NY (Must have a local candidate OR nearby states )
Experience looking for a minimum of 12+ Years
Azure certification plus.
Duration: 12-month contract.
# Position 1
Contract description
We are seeing a Senior Data Engineer contractor with expertise in data quality and database management. The ideal candidate will have a strong background in data engineering, particularly with Azure technologies and will be responsible for ensuring the integrity and quality of our data assets.
- Design, develop, and maintain data pipelines using Azure Data Factory and Databricks to support data integration and transformation processes.
- Administer and manage database and application servers, ensuring optimal performance and security.
- Implement and monitor data quality frameworks to ensure accuracy, completeness, and reliability of data across the organization.
- Collaborate with cross-functional teams to understand data requirements and provide data solutions that meet business needs.
- Support the integration of Collibra for data governance and stewardship, ensuring compliance with data management policies
Qualifications
- 8+ years of experience in data engineering, specifically with Azure Data Factory and Databricks.
- Database/Application Server Administration
- Data Quality Experience (Collibra/Owl DQ)
- Hadoop Administration
- Data Engineering on Azure (Azure Data Factory and Databricks)
- Understanding of Collibra
- Knowledge of Postgres and REST APIs
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.