Data Engineer

Overview

On Site
BASED ON EXPERIENCE
Contract - W2
Contract - Independent

Skills

Analytical Skill
Conflict Resolution
Problem Solving
Extract
Transform
Load
Tableau
Apache Hive
Continuous Integration
Continuous Delivery
Bamboo
Bitbucket
GitHub
Test-driven Development
Cloud Computing
Unix
Scripting
Linux
Apache Spark
Data Processing
Python
PySpark
SQL
Electronic Health Record (EHR)
Step-Functions
Amazon Lambda
Amazon S3
Amazon Web Services

Job Details

Job Description
Responsibilities
  • Analyze complex business problems, track down required information, document requirements, and develop technical solutions.
  • Strong analytical and problem-solving skills and the tenacity to overcome technical challenges.
  • Troubleshoot and optimize new and existing ETL packages.
  • Experience with AWS EMR, AWS Glue, AWS Athena, AWS Cloudformation, AWS IAM & S3, AWS SNS, Tableau, Hive.
  • Experience with CI/CD pipeline tools like Bamboo, Bitbucket, GitHub.
  • Experience with Test Driven Development.
  • Experience with building AWS cloud formation templates.
  • Experience with building server level architecture framework in AWS.
  • Experience with Unix scripting/Linux configuration preferred.
  • Experience building Spark data processing applications (Python, Pyspark)
  • Experience with Sql developnment.
Qualifications
  • Pyspark, SQL,AWS EMR, AWS Glue, AWS Athena, AWS Cloudformation, AWS IAM & S3, AWS SNS
  • Pyspark, SQL,AWS EMR, AWS Glue, AWS step functions, AWS Lambda, AWS Athena, AWS Cloudformation, AWS IAM & S3, AWS SNS
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.