Senior Data Engineer

Raleigh, NC, US • Posted 1 day ago • Updated 1 day ago
Full Time
No Travel Required
On-site
110000 - 130000/yr
Fitment

Dice Job Match Score™

📊 Calculating match score...

Job Details

Skills

  • API
  • Access Control
  • Continuous Integration
  • Data Governance
  • DevOps
  • Database
  • Extract, Transform, Load
  • Data Engineering
  • Cloud Computing
  • Python
  • PySpark
  • PL/SQL
  • XML
  • Continuous Delivery
  • GitLab
  • JSON
  • Microsoft Azure

Summary

Responsibilities:
Data Pipeline Architecture & Development
• Design and implement scalable, resilient data pipelines using Snowflake features including Snowpipe, Tasks, Streams, Dynamic Tables, and advanced SQL.
• Build and maintain DBT models with strong testing, documentation, and lineage.
• Develop Python ingestion frameworks for files and APIs, including schema validation, retries, and metadata capture.
• Engineer ingestion for CSV, fixed width multi record layouts, JSON, XML, Excel, and semi structured formats.
• Design Mainframe VSAM data ingestion pattern for complex EBCDIC data formats.
 
Schema Drift & Schema Evolution
• Detect, analyze, and manage schema drift across file, API, and replicated database sources.
• Implement metadata driven schema evolution strategies to ensure downstream stability.
• Coordinate schema changes through controlled CI/CD workflows.
 
Database Replication & CDC
• Configure and manage Qlik Replicate tasks for CDC and full load replication from Oracle, SQL Server, and DB2.
• Ensure idempotent, auditable, and recoverable replication pipelines with strong monitoring and reconciliation.
 
Data Governance, Security & Tokenization
• Implement and maintain Snowflake Data Masking policies, including dynamic masking, conditional masking, and role based masking rules.
• Apply Protegrity tokenization for sensitive data fields across ingestion and transformation layers.
• Enforce RBAC, data access controls, and governance standards across Snowflake and supporting systems.
 
Orchestration & Automation
• Build and schedule workflows using Astronomer Airflow, ensuring dependency management, retries, SLAs, and observability.
• Integrate pipelines with enterprise DevOps processes using GitLab and Azure DevOps for CI/CD automation.
 
Version Control & Code Quality
• Manage code repositories using GitLab, including branching strategies, merge requests, code reviews, and approvals.
 
Monitoring, Alerting & Performance Optimization
• Implement monitoring and alerting for ingestion pipelines, schema drift, replication, and transformation workloads.
• Optimize Snowflake compute, storage, and query performance; scale ingestion pipelines to meet evolving data volume and latency requirements.
 

Required Skills & Experience:

• 8+ years of hands on data engineering experience.
• Deep expertise with Snowflake, including data masking policies, RBAC, performance tuning, and advanced SQL.
• Strong experience with Qlik Replicate for CDC and database replication.
• Excellent proficiency in Python and Pyspark for ingestion frameworks and automation.
• Hands on experience with DBT Cloud and Astronomer Airflow.
• Experience with schema drift detection and schema evolution patterns.
• Experience with GitLab and CI/CD pipelines.
• Familiarity with Protegrity or similar data protection platforms.
 
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX1dbf00
  • Position Id: 9040471
  • Posted 1 day ago

Company Info

About INUIX Consulting

Inuix Consulting is well positioned to deliver the best-fit solution and support services to IT teams. Inuix Consulting vision is to become the preferred IT solutions partner to the global business community. Our aim is to help our clients recruit top talent, with ease. We ensure that our clients save money and time by providing end-to-end recruiting services. With our innovative ideas, detailed approach, and quality-oriented delivery of outsourced solutions we assist our clients to fulfill their tasks quickly and efficiently.

We provide a full range of secure IT solutions that are designed to increase productivity, enhance workflow optimization, and provide consistent uptime for our clients. Inuix Consulting seeks to leverage experts in leading edge technologies and industry best practices to deliver customers a comprehensive suite of IT solutions which includes:

  • IT Consulting Service
  • IT Managed Service
  • Technology Services
  • Digitization Services
  • Data Analytics
  • Enterprise Integration
  • Cloud Strategy
  • QA Service

 

Inuix Consulting goal is to exceed customers’ expectations by providing solutions in terms of quality, cost, and performance. We achieve our objective by deploying a highly skilled team of IT professionals to deliver effective solutions using state-of-the-art technology. A Best-in-Practice solutions and highly capable multi-disciplinary technology force from Inuix Consulting our clients achieve their technology objectives with faster ROI and Time-to-Market capability. With a unique Onsite/offshore global delivery model we deliver solutions with the precision required by our client. Dedicated Client Partner and Delivery manager are paired to work on your project from the start to the completion stage of the project as one amongst you.

Contact the job poster
SM

Shashank Mishra

IT Recruiter @ INUIX Consulting
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

It looks like there aren't any Similar Jobs for this job yet.

Search all similar jobs