Data Engineer – Snowflake, Informatica & Azure DevOps

Remote • Posted 6 hours ago • Updated 6 hours ago
Contract W2
Contract Independent
6 Months
Remote
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Summary

Job Description

We are seeking an experienced Data Engineer with strong expertise in Snowflake, Informatica, Azure DevOps, and enterprise data integration to support a large-scale data modernization and analytics initiative.

The Data Engineer will be responsible for designing, developing, testing, deploying, and maintaining enterprise ETL/ELT pipelines that integrate data from multiple source systems into centralized analytical platforms.

The ideal candidate will have hands-on experience with Snowflake data engineering, Informatica Cloud Data Governance and Catalog (CDGC), Terraform, CI/CD automation, data quality management, and complex data transformation processes.

The role involves close collaboration with Data Architects, Data Scientists, reporting teams, and implementation partners to ensure reliable, scalable, and secure data integration and analytics solutions.

Required Qualifications & Technical Skills

  • Snowflake ETL/ELT – Minimum 5 Years: Demonstrated experience designing, building, orchestrating, and optimizing complex ETL/ELT data pipelines and transformation logic natively within Snowflake.

  • Informatica CD– Minimum 1 Year: Hands-on experience with Informatica Cloud Data Governance and Catalog for metadata management, data profiling, cataloging, and automated data quality validation.

  • Terraform – Minimum 1 Year: Experience utilizing Infrastructure as Code (IaC) to provision, configure, and maintain cloud infrastructure and resources.

  • Azure DevOps: Demonstrated proficiency implementing automated build, testing, and deployment pipelines.

  • Git / Version Control: Expert knowledge of branching strategies, pull requests, automated merge checks, and code review processes.

  • Strong experience with SQL, data transformation, data cleansing, and enterprise data integration.

  • Knowledge of data warehousing, data modeling, data governance, and analytical data platforms.

  • Ability to troubleshoot complex data pipeline failures and optimize query performance.

Key Responsibilities

1. Data Ingestion & Pipeline Engineering

  • Design, develop, test, and deploy automated ETL/ELT pipelines using Informatica and Snowflake.

  • Integrate data from multiple enterprise systems, external partners, and third-party sources into centralized analytical platforms.

  • Develop data mapping and transformation processes to standardize and harmonize data from disparate source systems.

  • Implement automated data ingestion, validation, cleansing, and reconciliation processes.

  • Support the integration of structured data into enterprise data warehouse and analytics environments.

2. Data Transformation & Analytics Support

  • Develop and maintain transformation logic to convert raw data into structured, standardized, and analytics-ready datasets.

  • Implement data models and transformation processes aligned with established architecture standards.

  • Support longitudinal data analysis, reporting, and business intelligence requirements.

  • Develop and maintain Snowflake tables, views, and analytical models.

  • Optimize SQL queries, transformation processes, and warehouse performance.

3. Record Linkage & Data Quality Management

  • Implement record linkage and identity-matching processes across multiple data sources.

  • Develop data validation and reconciliation routines to ensure data accuracy and consistency.

  • Implement data quality checks, including:

    • Level 1: Structural and format validation.

    • Level 2: Completeness and duplicate detection.

    • Level 3: Referential integrity and business logic validation.

  • Maintain audit trails, data lineage, and metadata documentation.

  • Support compliance with applicable data privacy, security, and governance requirements.

4. Production Pipeline Operations & Support

  • Monitor and maintain scheduled ETL/ELT workflows and production data pipelines.

  • Troubleshoot pipeline failures, data loading errors, and transformation issues.

  • Manage late-arriving or corrected data files and execute necessary reloads.

  • Reconcile source and target record counts to ensure data completeness.

  • Maintain operational documentation, incident response procedures, and pipeline runbooks.

  • Optimize Snowflake compute utilization, query execution, and pipeline performance for cost efficiency and reliability.

5. Testing, CI/CD & Release Management

  • Develop and execute manual and automated test cases for data pipelines and transformation processes.

  • Utilize Azure DevOps and Azure Test Plans for testing, defect tracking, and release management.

  • Support deployment activities across Development, Test, UAT, and Production environments.

  • Conduct peer code reviews and enforce version control best practices.

  • Maintain detailed release documentation, change logs, and deployment records.

  • Ensure successful validation and testing before production releases.

6. Knowledge Transfer & Operational Transition

  • Collaborate with implementation partners and technical teams during knowledge-transfer activities.

  • Participate in shadowing, co-running, and independent execution of production data operations.

  • Support the transition of data pipeline ownership from implementation teams to internal operations.

  • Develop technical documentation and operational procedures for long-term maintenance.

  • Independently manage production feed cycles, troubleshoot issues, and support operational continuity.

7. Cross-Functional Collaboration

  • Partner with Data Architects to review logical and physical data models and pipeline designs.

  • Collaborate with Data Scientists and reporting teams to prepare datasets for analytical and visualization requirements.

  • Support Tableau dashboards and other reporting solutions through reliable data integration.

  • Coordinate with infrastructure and operations teams on Snowflake resource management, permissions, and CI/CD processes.

  • Participate in technical discussions, design reviews, and solution planning activities.

Preferred Qualifications

  • Previous experience working with public sector, education, or workforce data systems.

  • Experience handling large-scale longitudinal datasets and complex data integration environments.

  • Knowledge of record linkage, entity resolution, and deterministic/probabilistic identity matching.

  • Familiarity with FERPA, COPPA, and applicable data privacy and suppression standards.

  • Experience developing structured test plans and executing tests using Azure Test Plans.

  • Experience supporting enterprise data modernization and cloud-based analytics initiatives.

  • Strong troubleshooting, analytical, communication, and documentation skills.

Expected Deliverables

  • Production-ready Informatica and Snowflake ETL/ELT pipelines.

  • Automated data cleansing, validation, and reconciliation modules.

  • Record linkage and identity-matching routines.

  • Snowflake transformation objects, analytical tables, and reporting views.

  • Data mapping specifications and source-to-target documentation.

  • Data lineage diagrams and technical architecture documentation.

  • Operational runbooks and incident response procedures.

  • Azure Test Plans, test execution records, and defect logs.

  • Release documentation and deployment change logs.

  • Production monitoring reports and data quality summaries.

Work Arrangement & Contract Details

  • Position: Data Engineer

  • Contract Duration: 6 Months

  • Extension: Possible, based on project performance and funding.

  • Work Arrangement: Remote / Telecommuting

  • Location Requirement: Must currently reside in Colorado and remain within the state for the duration of the engagement.

  • Preferred Location: Denver Metro Area

  • Local Candidates: Strongly preferred.

Important: Candidates must meet the required technical experience and location requirements to be considered.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91138017
  • Position Id: 26-01355
  • Posted 6 hours ago

Company Info

About OP Consulting Group LLC

OP Consulting Group was formed by an IT Consultant who was frustrated with the current practices in the staffing industry. With a determination to bring change in the staffing practices, we came up with some bold business practices. We also offer complimenting services of Training and Consulting.

We are not just a middleman but are your partner to help turn your goals into reality. We do not see a job opportunity as a single transaction but the beginning of a long-term relationship.

OP Consulting Group’s promises to you are:
• Upfront and transparent pay rate
• We keep low margins
• Frequent and proactive communication of submission status
• We only work with direct clients or prime vendors
• On-time payment

About_Company_One
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.