Data Pipeline Engineer

Overview

Remote
$57 - $62
Contract - W2

Skills

Databricks
SQL Azure
Microsoft SQL Server
SQL
Python
PySpark
Kubernetes
Microsoft Azure
Data Storage
ELT
Extract
Transform
Load
Data Integration
Big Data
Normalization
Optimization
Scalability
Virtual Machines
Data Governance
Data Processing
Data Modeling
Data Security
Data Quality

Job Details

Description

As a Big Data Architect Contractor, you will support the project team by designing and implementing large-scale data solutions to meet business needs. Design and develop scalable big data architectures to handle large volumes of data. Collaborate with stakeholders to understand data requirements and translate them into technical solutions. Implement data integration, data processing, and data storage solutions using big data technologies. Ensure data security, data quality, and data governance standards are met. Optimize data architectures for performance, scalability, and cost-efficiency.

Primary Skill Required for the Role: Databricks

Level Required for Primary Skill: Advanced (6-9 years experience)

Additional Skills Requested for Role:

  • Microsoft - SQL Azure - Advanced (6-9 years experience)
  • Data Modeling - Advanced (6-9 years experience)
  • DATA ENGINEERING - Advanced (6-9 years experience)

Additional Details for Role:

Data Pipeline Engineer
Skills:

  • Databricks (Python and SQL/PySpark)
  • Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs)
  • Data modeling and ETL/ELT design patterns
  • Docker and Azure Kubernetes Service (AKS) for select automation
  • Performance optimization and scalability

Experience:

  • 7+ years enterprise data engineering
  • Healthcare data integration experience strongly preferred
  • Experience with large-scale data harmonization and normalization
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About HCM Staffing and Consulting