Data Engineer

TQUAL is seeking a Data Engineer for it''s Data modernization project which includes a full rebuild on a modern, Microsoft-centric data stack. The new warehouse replaces the legacy one with a properly designed dimensional model, automated transformations, an observable orchestration layer, a rebuilt Power BI semantic layer, and the documentation and test coverage a small in-house team can run on its own once we’re done.

Key Responsibilities

·      The data platform : cloud infrastructure, networking and security plumbing, dev/stage/prod environments, CI/CD, and secret management.

·      Source data ingestion from roughly a dozen systems spanning ERP, CRM, HR, file drops, and a couple of REST APIs. Mix of Fivetran, Azure Data Factory, and light Python where needed.

·      Production orchestration and observability: scheduling, retries, freshness monitoring, alert routing, ops dashboards.

·      The technical cutover from the legacy warehouse to the new platform, and the eventual decommission of legacy infrastructure (SQL Agent jobs, linked servers, archival).

Required skills and experience

·      5+ years in a data engineering or analytics platform role.

·      Strong Azure footing (Client is Microsoft-heavy): Azure SQL or Synapse or Fabric, Storage, networking, Key Vault, Entra ID.

·      Hands-on production experience with Fivetran and Azure Data Factory.

·      Comfortable with Git, CI/CD pipelines, infrastructure-as-code (Terraform, Bicep, or ARM), and secret rotation.

·      Some Python (custom API connectors, small utility scripts). Doesn’t need to be deep.

·      API integration experience: REST authentication patterns, pagination, retry/backoff, rate-limit handling.

·      SQL Server fluency sufficient to read the legacy COMMONDATA stored procs you’re replacing.

Nice-to-have

·      Microsoft Fabric (Lakehouse, Warehouse, Pipelines).

·      Power Automate familiarity (we’re replacing several Power Automate flows tied to the legacy procs).

·      Experience decommissioning a legacy warehouse: linked-server cleanup, SQL Agent job retirement, archival.

·      SOX or similar audit/compliance exposure in a data context.

·      Power BI gateway and dataset refresh administration.