Data Engineer

Overview

Hybrid
Depends on Experience
Full Time

Skills

SQL
aws
RDS
EMR
Cloudwatch
Lambda
SNS
State Machine
Fargate
RESTful

Job Details

AWS Data Engineer

Hybrid in Reston VA

Job description

description
Job Description
At least 5 years of relevant Data Engineering and insight experience
5+ years of Python with very strong AWS experience in delivering Python based solutions
Skilled in SQL and experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
5+ years of recent experience with building and deploying applications in AWS using services like (S3,Glue,Redshift,RDS,AWS EMR, Cloudwatch, Lambda, State Machine, SNS, SQS, ECS Fargate, AppFlow, etc.)
At least 2 years of experience in APIs, RESTful services.
Skilled in cloud technologies and cloud computing
Strong experience building CI/CD pipelines on AWS (CloudFormation and Gitlab)
Good communication skills and ability to work in a team environment.
Ability to work independently as well as part of an agile team (Scrum / Kanban)
Programming including coding, debugging, and using relevant programming languages
Focused on manipulating data in a software engineering capacity.
Some of that data might live in relational systems, but its increasingly moving towards NoSQL systems and data lakes.
Normalize databases and ascertain the structure of the data meets the requirements of the applications that are accessing the information.
Construct datasets that are easy to analyze and support company requirements.
Combine raw information from different sources to create consistent and machine-readable formats.
Skills: This IT role requires a significant set of technical skills, including a deep knowledge of SQL, data modeling, and tools like Spark/Hive/Airflow.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.