Senior Data Engineer

Overview

Hybrid
Depends on Experience
Contract - W2
No Travel Required

Skills

Python
Scala
Data Modeling
Warehousing
star schema
snowflake schema
Amazon Web Services
Data Engineering
Data Architecture

Job Details

DataStaff, Inc. is in need of a Senior Data Engineer for a long-term contract opportunity with one of our direct clients located in Durham, NC
*This position is hybrid.
Responsibilities:

  • Lead the development and optimization of the data pipelines, analytics solutions, and cloud-based data platforms.
  • Designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
  • Design, Develop and maintain data models in Synapse to support reporting and analytics
  • Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
  • Analyze the source system and design the ETL data load.
  • Ability to create and configure Azure Synapse Analytics workspace.
  • Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like Salesforce.
  • Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
  • Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.

Required Skills:

  • 5 Years - Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows
  • 3 Years - Programming Languages: Strong proficiency in Python or Scala for data processing.
  • 7 Years - SQL Mastery: Advanced query writing, performance tuning, and optimization.
  • 4 Years - Experience with Data Modeling and Warehousing (star schema, snowflake schema)
  • 5 Years - Experience with ETL/ELT processes

Desired Skills:

  • 4 Years - Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database)
  • 4 Years - Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions
  • 1 Year - Experience with Programming and Scripting (SQL, T-SQL, and data query optimization)
  • 5 Years - Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage
  • 1 Year - Experience with Power BI


This position is available as a corp-to-corp or W2 position with a competitive benefits package. DataStaff offers medical, dental, and vision coverage options as well as paid vacation, sick, and holiday leave. As many of our opportunities are long-term, we also have a 401k program available for employees after 6 months.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.