Senior Data Engineer

Overview

BASED ON EXPERIENCE
Contract - W2
Contract - Independent

Skills

Databricks
Amazon Web Services
Microsoft Azure
MySQL
Electronic Data Interchange
Health Care
ADF
Python
PySpark
Code Refactoring
PHP
System Testing
Help Desk
Visualization
Business Process
Management
Stored Procedures
Transact-SQL
Relational Databases
Microsoft SQL Server
Database
SQL
Performance Tuning
Collaboration
Database Administration
Database Design
Software Development
Debugging
Data Warehouse
Reporting
Data Analysis
Extract
Transform
Load

Job Details

Senior Data Engineer
Remote
C2H - This is contract to hire so the resource needs to be eligible for conversion. Required Candidates

Looking for a strong Data Engineer with Azure Data Factory and Databricks - Healthcare experience preferred highly.


Seeking an experienced Data Engineer - Need strong skills in Azure Data Factory & Databricks. Refactoring applications from AWS to Azure. (MySQL, EDI Protocols nice to have from a healthcare perspective) - Need to be able to create data pipelines using ADF. Python, Pyspark great to have. Transitioning/refactoring from PHP to ETL.

The purpose of this position is to perform Data Development functions which include: the design of new or enhancement of existing enterprise database systems; maintenance and/or development of critical data processes; unit and system testing; support and help desk tasks. It also requires defining and adopting best practices for each of the data development functions as well as visualization and ETL processes. This position is also responsible for architecting ETL functions between a multitude of relational databases and external data files.

Essential Duties and Responsibilities
  • Work with a highly dynamic team focused on Digital Transformation.
  • Understand the domain and business processes to implement successful data pipelines.
  • Provide work status, and coordinate with Data Engineers.
  • Manage customer deliverables and regularly report the status via Weekly/Monthly reviews.
  • Design, develop and maintain ETL processes as well as Stored Procedures, Functions and Views
  • Program in T-SQL with relational databases including currently supported versions of Microsoft SQL Server.
  • Write high performance SQL queries using Joins, Cross Apply, Aggregate Queries, Merge, Pivot.
  • Design normalized database tables with proper indexing and constraints.
  • Perform SQL query tuning and performance optimization on complex and inefficient queries.
  • Provide guidance in the use of table variable, temporary table, CTE appropriately to deal with large datasets.
  • Collaborate with DBA on database design and performance enhancements.
  • Leading in all phases of the software development life cycle in a team environment.
  • Debug existing code and troubleshoot for issues.
  • Design and provide a framework for maintaining existing data warehouse for reporting and data analytics.
  • Follow best practices, design, develop, test and document ETL processes.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.