Data Engineer, Hadoop, SPARK, Python, Shell, CI/CD, Hive, Snowflake, SQL 12+ Mts Con, Alpharetta, GA

Description:

Big Data Engineer

Job Description

Role Name: Big Data Engineer, Python, Big Data (HDFS/Hive/Impala) & Apache Spark, Snowflake, ETL, Github, Devops, Shell 12+ Mths Cont, Alpharetta, GA

Position Title: Consultant

Location: Alpharetta, GA

Position Description:
This position is for Big data engineer for Wealth Management Framework CoE team at Client's Alpharetta or New York offices.
CoE team is responsible to define and govern the data platforms.
We are looking for colleagues with strong sense of ownership and ability to drive solutions.
The role is primarily responsible to automate the existing process and bring new ideas and innovation.
The candidate is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation.
The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision.

Responsibilities

Required Skills
* 7+ years of Data engineering experience
* Must be strong in UNIX Shell, Python scripting knowledge
* Must be strong in Spark
* Must have strong knowledge of SQL
* Hands-on knowledge on how HDFS/Hive/Impala/Spark works
* Strong in logical reasoning capabilities
* Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
* Strong collaboration and communication skills
* Must possess strong team-player skills and should have excellent written and verbal communication skills
* Ability to create and maintain a positive environment of shared success
* Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
* Good to have working experience on snowflake & any data integration tool i.e. informatica cloud

Desired skills
* Snowflake/Azure/AWS any cloud
* IDMC/any ETL tool