Data Engineer - Enterprise Supplier Management (10+ Years Experience)

Overview

Remote
$100,000 - $120,000
Contract - W2
Contract - 14 Month(s)

Skills

API
AWS Batch
Amazon Lambda
Amazon S3
Automated Testing
Data Lake
Pandas
Publishing
PySpark
Python
SQL
Scratch
Snow Flake Schema
Streaming

Job Details

Requirement:
Prefer internal proprietary tooling Bogie, OneStream, OnePipeline, etc
Need an understanding of API s and how to call them. Won t be creating from scratch.
Will be publishing data to existing API processes. OneStream to get data to the Data Lake.
Experience with Airflow Job Description:
1. AWS - Lambda, s3, airflow, aws batch, fargate.
2. Python - data frames and pandas.
3. Streaming/API development
4. SQL - Snowflake
5. Jenkins Nice to have but not necessary
1. PySpark
2. Capital One test automation
3. Bogie
4. OneStream
5. OnePipeline

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Care IT Services Inc