Data Engineer

Overview

Remote
On Site
USD 50-55
Full Time
Part Time
Accepts corp to corp applications
Contract - Independent
Contract - W2

Skills

SQL
ETL

Job Details

Experienced SR Data Engineer: 8+ years of experience working with data infrastructure, ETL processes, and large-scale datasets.

Proficient in SQL & Python: Strong knowledge of SQL for querying and manipulating data and experience with Python for scripting and automation.

PowerShell experience - this is our scripting language of choice.

Proficiency with parquet and delta formats

Cloud & Big Data: Hands-on experience with Azure cloud and distributed processing (Spark). Experience in Azure technologies like Azure Data Factory, Azure Databricks using Python, Azure Data Lake Storage, Azure Functions, AzureDevOps for CI/CD and Logic App.

Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources)

Strong understanding of data warehousing concepts and dimensional modeling.

Strong understanding of software development lifecycle from planning to deployment. We follow a standard deployment process (dev, test, prod) that includes peer reviewed code

Problem Solver & Innovator: Passionate about solving complex data challenges and improving system efficiency.

Team Player & Communicator: Strong collaboration skills, with the ability to explain technical concepts to non-technical stakeholders.


Must Have Skills

- Skill 1 7 Yrs of Exp SQL & Python

- Skill 2 7 Yrs of Exp , PowerShell & Spark

- Skill 3 5Yrs of Exp Azure Data Factory & AzureDevOp

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.