Big Data Engineer - ONLY Alpharetta, GA CANDIDATES NEEDED

  • Alpharetta, GA
  • Posted 1 day ago | Updated 16 hours ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Responsibilities * Design & Develop new automation framework for ETL processing * Support existing framework and become technical point of contact for all related teams * Enhance existing ETL automation framework as per user requirements * Performance tuning of spark
snowflake ETL jobs * New technology POC and suitability analysis for Cloud migration * Process optimization with the help of automation and new utility development * Work in collaboration for any issues and new features * Support any batch issue * Support application team teams with any queries Required Skills * 7+ years of Data engineering experience * Must be strong in UNIX Shell
Python scripting knowledge * Must be strong in Spark * Must have strong knowledge of SQL * Hands-on knowledge on how HDFS/Hive/Impala/Spark works * Strong in logical reasoning capabilities * Should have working knowledge of Github
DevOps
Big Data & Apache Spark Desired skills * Snowflake/Azure/AWS any cloud * IDMC/any ETL tool
Continuous Integration and Development
Cloud Computing
Cloudera Impala
Collaboration
Communication
Amazon Web Services
Apache HTTP Server
Apache Hive
Apache Spark
Big Data
Data Engineering
Data Integration
Extract
Transform
Load
GitHub
HDFS
Process Optimization
Python
Reasoning
SQL
Scripting
Shell
Snow Flake Schema
Informatica
Management
Microsoft Azure
Migration
POC
Performance Tuning
Unix
Big Data Engineer

Job Details

Responsibilities
* Design & Develop new automation framework for ETL processing
* Support existing framework and become technical point of contact for all related teams
* Enhance existing ETL automation framework as per user requirements
* Performance tuning of spark, snowflake ETL jobs
* New technology POC and suitability analysis for Cloud migration
* Process optimization with the help of automation and new utility development
* Work in collaboration for any issues and new features
* Support any batch issue
* Support application team teams with any queries

Required Skills
* 7+ years of Data engineering experience
* Must be strong in UNIX Shell, Python scripting knowledge
* Must be strong in Spark
* Must have strong knowledge of SQL
* Hands-on knowledge on how HDFS/Hive/Impala/Spark works
* Strong in logical reasoning capabilities
* Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
* Strong collaboration and communication skills
* Must possess strong team-player skills and should have excellent written and verbal communication skills
* Ability to create and maintain a positive environment of shared success
* Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
* Good to have working experience on snowflake & any data integration tool i.e. informatica cloud

Primary skills: Python, Big Data & Apache Spark

Desired skills
* Snowflake/Azure/AWS any cloud
* IDMC/any ETL tool

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Zealogics