Data Engineer

  • Needham, MA
  • Posted 6 hours ago | Updated 6 hours ago

Overview

Remote
Hybrid
Depends on Experience
Contract - W2

Skills

Oracle Fusion
Python
Amazon Web Services

Job Details

Must have: DBT, SnowFlake, Python, Dagster, AWS, S3

Experience with OCI (Oracle Cloud Infrastructure) and Oracle Cloud services, including Oracle Fusion, is a big plus.

Responsibilities:

  • Writing and building Python-based data pipelines
  • Scheduling and parameterizing those pipelines using Dagster
  • Parameterizing means making things easily adjustable so the data pipelines can adapt to different needs instead of having to be completely redone every time there s a new business need.
  • Working in an AWS + Snowflake environment
  • Handling data stored in S3
  • Moving data into Snowflake from various sources

Nice to Have Skills:

Ability to model up through medallion architecture using DBT. Which means:

This means the person knows how to organize and transform data in a structured way using DBT (a data transformation tool), following something called the medallion architecture.

Medallion architecture: A layered approach to data transformation that separates data into:

Bronze (raw data),

Silver (cleaned and filtered),

Gold (final, business-ready data).

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.