SLDS Data Engineer

Denver, CO, US • Posted 3 hours ago • Updated 3 hours ago
Full Time
On-site
$55 - $60 per hour
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Analytical Skill
  • Data Cleansing
  • Presentations
  • Engineering Design
  • Incident Management
  • Regulatory Compliance
  • Quality Assurance
  • Code Review
  • Development Testing
  • Acceptance Testing
  • Test Cases
  • Amazon SES
  • PSAT
  • Knowledge Transfer
  • Data Loading
  • Hardening
  • Modeling
  • Performance Tuning
  • Release Management
  • Automated Testing
  • Visualization
  • Tableau
  • Dashboard
  • Higher Education
  • IHE
  • Management
  • Warehouse
  • SQL
  • Physical Layer
  • Data Link Layer
  • Network Layer
  • Layout
  • IDS
  • Analytics
  • Use Cases
  • Data Extraction
  • Scripting
  • IT Architecture
  • Mapping
  • Data Mapping
  • Data Modeling
  • Documentation
  • Standard Operating Procedure
  • Failover
  • Testing
  • Reporting
  • Test Suites
  • Manual Testing
  • Promotions
  • Auditing
  • Extract
  • Transform
  • Load
  • ELT
  • Snow Flake Schema
  • Informatica
  • Cloud Computing
  • Data Governance
  • Meta-data Management
  • Data Profiling
  • Data Quality
  • Terraform
  • ProVision
  • IaaS
  • Continuous Integration
  • Continuous Delivery
  • DevOps
  • Git
  • Version Control
  • Workflow
  • Public Sector
  • Microsoft Azure
  • Test Plans
  • Telecommuting
  • IT Service Management
  • Innovation
  • Collaboration
  • Recruiting
  • Artificial Intelligence
  • Privacy
  • Insurance
  • Finance
  • Professional Development
  • Training
  • Leadership
  • CompTIA
  • Customer Service
  • Career Counseling
  • SAP BASIS
  • Law
  • ADA
  • Apex
  • Oracle Application Express

Summary

Job#: 3059925

Job Description:

SLDS Data Engineer (REMOTE) in Denver, Colorado

Job Description:

The Data Engineer is responsible for realizing the vision of the Data Architect through the technical implementation of data pipelines using Snowflake and Informatica. Data Engineers are technical coding experts focused on moving data from line-of-business, transactional, or partner agency source systems into analytical data platforms, building transformations, managing data cleansing and quality, and presenting structured data for consumption by analysts and scientists.

A Data Engineer is expected to join the project team in January 2027 under a shared delivery model with a 3rd party implementor. The Data Engineer will participate in a structured knowledge-transfer progression (shadowing, co-running, and checking), leading specific new source ingestions, and progressively will take over production operations and upkeep of the SLDS data foundation and analytics layer.

What You'll Do:
  • Data Ingestion & Pipeline Engineering: Design, develop, test, and deploy automated ETL/data pipelines in Informatica and Snowflake to ingest data from partner state agencies and third parties into the SLDS common data model.


  • Transformation & Analytics Layer Support: Implement transformation logic to convert raw agency feeds into harmonized, linked longitudinal records and analytics layer data models, adhering to core naming and modeling standards established with the Data Architect.


  • Record Linkage & Identity Matching: Execute the SLDS internal matching logic to link newly ingested agency records to master longitudinal student and workforce profiles, handling match exceptions and cross-agency reconciliations.


  • Production Pipeline Operations & Incident Response: Maintain operational ownership of scheduled feed runs, monitoring job execution, resolving run failures, reloading late or corrected files, reconciling row counts, and rebuilding downstream objects.


  • Data Quality & Governance Compliance: Implement L1 (structural/format), L2 (completeness/de-duplication), and L3 (referential integrity/logic) validation checks, layout-change detection, and audit trails; enforce data privacy, suppression rules, and compliance standards (FERPA, COPPA, ADA, and state statutes).


  • Performance Optimization & Platform Stewardship: Optimize query execution, warehouse compute, and pipeline performance for cost and latency; identify and tune heavily used models and performance hot spots in Snowflake.


  • Quality Assurance, Code Review & Promotion: Adhere to the unified release process across Development, Test, UAT, and Production environments using Azure DevOps and Azure Test Plans; author and execute test cases, conduct peer code reviews, and maintain release change logs.


Ingestion & Pipeline Development

CDHE Courses Data Ingestion:

Ingest and validate annual postsecondary course-level data files from CDHE per data sharing agreements.

Build ETL mapping processes from CDHE course files into the SLDS common data model based on design specifications provided by 3rd party implementation partner.

Pair with 3 party implementation team during ETL construction, validation, and promotion.

Postsecondary SES & Disability Data Ingestion (Conditional):

Ingest and validate demographic, Pell Grant eligibility, and disability classification codes from postsecondary sources.

Apply mandated privacy protections, cell suppression rules, and permissible-use governance requirements.

PSAT/SAT Assessment Data Ingestion (Conditional):

Ingest, validate, and map section/composite assessment scores and grade levels from the College Board or CDE.

Execute identity matching to connect assessment records to existing longitudinal student profiles.

Knowledge Transfer & Operational Transition (Jan-April 2027)

Shadowing & Co-running (Jan-Feb 2027):

Shadow 3rd party implementation partner engineers on day-to-day operations of existing data feeds (e.g., NSC, K-3, CDEC, and Phase 1 feeds).

Co-run live feed cycles, handle data loading, execute record matching, and troubleshoot exceptions alongside 3rd party implementation partner.

Readiness Gate Execution (Target: March 2027):

Run two consecutive feed cycles completely unaided to achieve formal operational hand-over sign-off.

Full Production Operations (March 2027 Onward):

Execute recurring feed schedules, rebuild downstream objects, reconcile row counts against source files, and triage failed jobs.

Address ad-hoc data inquiries and export requests from OIT leadership and partner agencies.

Data Stabilization & Analytics Layer Upkeep

Stabilization Backlog Support: Resolve identified data reliability defects, run variations, and de-duplication issues transitioned from the Phase 1 stabilization backlog.

Analytics Layer Hardening & Maintenance (April 2027 Onward):

Apply object modeling standards, naming conventions, and layout-change detection into the RAW layer.

Perform ongoing reconciliation of analytics layer outputs across non-production and production environments.

Implement metric and calculation enhancements prioritizing downstream use cases (program participation, completion, equitable access, and wage outcomes).

Conduct query profiling and performance tuning on dashboard back-end models.

Cross-Functional Collaboration & Testing

Testing & Release Management: Author manual and automated test cases in Azure Test Plans; record execution evidence and resolve defect bugs before promoting code.

Cross-Role Support:

Partner with the Data Architect to review and adapt physical and logical data models and pipeline designs.

Support the Data Scientist / Visualization Designer by integrating new data sources to power Tableau dashboard refreshes and preparing source tables for de-identified Institution of Higher Education (IHE) outcome files.

Coordinate with Operations Engineers on Snowflake compute management, warehouse auto-shutdown, user role permissions, and CI/CD promotion pipelines.

Technical Code & Pipeline Artifacts:

  • Production ETL/ELT Pipelines: Fully developed, scheduled Informatica workflows and Snowflake SQL/transformation pipelines for CDHE Courses and existing operational feeds.


  • Cleansing & Validation Modules: Automated L1, L2, and L3 quality-check rules and Informatica layout-change detection routines in the RAW layer.


  • Identity Matching & Linkage Routines: Documented internal matching scripts linking new partner agency student/workforce records into longitudinal IDs.


  • Analytics Layer Transformation Objects: Production views, tables, and metric models in Snowflake aligned with longitudinal reporting use cases .


  • De-Identified Data Extraction Scripts: Data extraction scripts that generate de-identified, suppressed outcome files for participating IHEs per specification.


Documentation & Engineering Specifications:

  • ETL Pipeline Design Documents: Technical architecture and transformation specifications detailing source-to-target logic, schemas, and dependencies.


  • Mapping & Transformation Specifications: Contribution to enterprise data mapping documents aligning source fields to the SLDS common data model.


  • Lineage Documentation & Dependency Maps: As-built data lineage records and dependency diagrams detailing object-level upstream and downstream flows.


  • Operational Runbooks & Incident Procedures: Standard operating procedures for running feed cycles, handling late or malformed files, performing failover, and reconciling row counts.


Governance, Testing & Operational Reporting:

  • Azure Test Plans & Execution Records: Fully documented test plans, test suites, manual test run results, and defect logs for all pipeline modifications prior to production promotion .


  • Release Change Logs: Detailed audit entries for all OIT-led production releases, detailing changes, rationales, linked Azure DevOps work items, test results, and deployment timestamps].


  • Feed Operation Run Logs & Match Summaries: Run completion records, reconciliation totals, exception logs, and data-quality summaries produced for agency loads.


Required Qualifications:
  • Snowflake ETL/ELT: Minimum 5 years of demonstrated experience building, orchestrating, and optimizing complex ETL/ELT data pipelines and transformation logic natively within the Snowflake platform.


  • Informatica CDGC: Minimum 1 year of hands-on experience working with Informatica Cloud Data Governance and Catalog (CDGC) for metadata management, data profiling, cataloging, and automated data quality validation.


  • Infrastructure as Code (IaC): Minimum 1 year of experience utilizing Terraform to provision, configure, and maintain cloud infrastructure and resources.


  • CI/CD & DevOps: Demonstrated proficiency implementing automated build, test, and release deployment pipelines using Azure DevOps.


  • Version Control: Expert proficiency with Git / version control workflows (branching strategies, pull requests, automated merge checks, code reviews).


  • Location Constraint: Must currently reside within the State of Colorado for the duration of the engagement.


Preferred Qualifications:
  • Prior experience working with public sector, longitudinal education, and workforce data systems (e.g., CDE, CDHE, CDLE, CDEC, National Student Clearinghouse).


  • Experience with record linkage, entity resolution, and deterministic/probabilistic identity matching across disparate public records


  • Familiarity with federal and state student/workforce privacy regulations, including FERPA, COPPA, and cell suppression standards


  • Experience authoring and executing structured test plans in Azure Test Plans


  • Position Type: 6-Month Contract (with possibility of extension based on project performance and state funding)


  • Work Arrangement: Remote / Telecommuting (Candidate must reside within the State of Colorado; strong preference for local / Denver Metro candidates)


Background checks:

Statewide Criminal Verification

Federal Criminal Verification

SSN Trace

Global Monitor Check

Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.

Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at

Everforth Apex Benefits Overview: Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Everforth Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Everforth Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Everforth Apex team member can provide.

Everforth Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law.

If you require an accommodation under the Americans with Disabilities Act to participate in an interview with a virtual recruiter or to use our website for a search or application, please contact our Benefits Department at or . Please note that this contact information is strictly to be used for medical ADA accommodations and that no other inquiries will be answered.

UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex Systems.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: apexsan
  • Position Id: BHJOB2374_3059925
  • Posted 3 hours ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.