Lead Data Engineer

Overview

Remote
$70 - $75
Part Time
No Travel Required

Skills

Amazon S3
Amazon Web Services
Apache Spark
Bash
Credit Cards
Data Engineering
Data Warehouse
Databricks
Electronic Health Record (EHR)
JIRA
Java
Python
SQL
Scripting
Snow Flake Schema
Capital one
Lead Data Engineer
AWS
Capital One formers

Job Details

REMOTE OPPORTUNITY

Top Skills - Must Haves

  • Python
  • Sql
  • Aws
  • Data
  • Etl
  • Integration
  • Big data
  • Agile
  • snowflake
  • databricks
  • EMR
  • Glue
  • Lambda
  • cloudwatch
  • S3

Top Skills' Details

  • Discover's historical credit card data will be in the Client ecosystem and these Engineering teams will be responsible for picking the data up, transforming and loading into target state, which could be Snowflake or AWS S3
  • 6 Data Engineering teams with 2 Midlevel Data Engineers each (Capital One formers required)

Must Have:

  • AWS(EMR/Glue, S3, Lambda, Cloudwatch), Python/Java, Spark, Databricks, SQL, Bash)
  • Python use: scripting, building new data pipelines (not app dev)

Data warehousing experience (Snowflake)

  • APIs
  • Agile engineering practices & JIRA usage
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.