Cloud Data Engineer

Overview

On Site
Contract - W2
Contract - 31 day((s))

Skills

data architecture
snowflake
Azure Data Factory
databricks
PySpark
data pipelines
Json
Data modelling
governance
Data Quality
cloud computing
Python (Programming Language)
SQL Databases
Apache Spark
Extract Transform Load (ETL)
Data Analysis
Unstructured Data
Agile Methodology
Business Process Improvement
Data Normalisation
Data Transformation
SQL Stored Procedures
Data Systems
Extensible Markup Language (XML)
Parsing
Raw Data
Semi-structured Data

Job Details

Job Role - Cloud Data Engineer

Location - Minneapolis, MN(Remote)

Job Details:

Cloud Data Engineer with over 5 years of experience in managing structured and unstructured data, performing deep data analysis, and building scalable data pipelines. The ideal candidate will have hands-on expertise in Azure Data Factory (ADF), Snowflake, Databricks, and Python/PySpark, with a strong understanding of cloud-based ETL processes and data normalization techniques.

Skills Used - ADF, Databricks, Python/ Pyspark, SQL, Snowflake

Key Responsibilities

Analyze and organize raw data from diverse sources, including healthcare datasets.

Design and implement ETL pipelines using Azure Data Factory.

Develop and optimize SQL queries, stored procedures, and data models in Snowflake.

Parse and flatten semi-structured data (XML, JSON) using Snowflake and SQL.

Build scalable data systems and pipelines to support analytics and reporting.

Migrate on-premise data workloads to cloud platforms, preferably Snowflake.

Work with Databricks using PySpark, SparkSQL, and Python for data transformation.

Ensure data quality through profiling, validation, and adherence to governance standards.

Collaborate in Agile development environments and contribute to continuous improvement.

Identify opportunities to enhance data architecture and storage efficiency.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About DRC Systems USA LLC