Data Engineer (Azure / AWS)

Overview

On Site
Depends on Experience
Contract - W2

Skills

Agile
Amazon EC2
Amazon RDS
Amazon S3
Amazon Web Services
Analytics
Apache Airflow
Cloud Computing
Confluence
Continuous Delivery
Continuous Integration
Data Engineering
Data Lake
Data Modeling
Database
Databricks
ELT
Electronic Health Record (EHR)
Extract
Transform
Load
JIRA
Microsoft Azure
Microsoft SQL Server
Optimization
Oracle
Performance Tuning
PostgreSQL
Python
Relational Databases
Remote Desktop Services
SQL
Storage
Streaming
Testing
Workflow

Job Details

Responsibilities:

  • A minimum of 10 years of experience in data engineering or a similar technical role

  • Strong hands-on proficiency with AWS services such as EC2, EMR, Glue, S3, RDS, and PostgreSQL

  • Expertise in Apache Airflow, DBT Cloud, Python, SQL, and Snowflake

  • Work on data modeling, ingestion, preparation, and testing.

  • Build and maintain CI/CD pipelines and ensure performance tuning.

  • Familiarity with agile development methodologies and tools like Jira, Confluence, or Align

  • Develop ETL/ELT workflows using Python and SQL
  • Design, build, and maintain scalable and efficient data pipelines

  • Work with relational databases (Oracle, PostgreSQL, SQL Server, etc.).

  • Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Databricks, etc.
  • Strong understanding of Azure services and expertise on Data Lake, Data Factory and Data Bricks
  • Perform data modeling, performance tuning, and optimization of database queries

  • Implement batch & streaming data pipelines in the cloud.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.