Overview
On Site
USD 61.00 - 80.00 per hour
Contract - W2
Skills
Recruiting
SAP BASIS
Innovation
Software Architecture
Supervision
Performance Tuning
POC
Migration
Process Optimization
Data Engineering
Unix
Shell
Scripting
SQL
HDFS
Apache Hive
Cloudera Impala
Reasoning
GitHub
DevOps
Continuous Integration and Development
Collaboration
Communication
Management
Data Integration
Informatica
Python
Big Data
Apache Spark
Snow Flake Schema
Microsoft Azure
Amazon Web Services
Cloud Computing
Extract
Transform
Load
Job Details
Our client is hiring a Big Data Engineer on a long-term contract basis.
Work Location: Alpharetta, Georgia
Work Model: Hybrid
Summary: This position is for a Big Data Engineer for the Framework CoE team. The CoE team is responsible for defining and governing data platforms. The role is primarily responsible for automating existing processes and bringing new ideas and innovation. The candidate is expected to code, conduct code reviews, and test frameworks as needed, along with participating in application architecture and design and other phases of automation. The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision.
Responsibilities:
Required Qualifications:
Primary skills: Python, Big Data & Apache Spark Desired skills
Pay Rate: $61 - $80
Job ID: 84092
Work Location: Alpharetta, Georgia
Work Model: Hybrid
Summary: This position is for a Big Data Engineer for the Framework CoE team. The CoE team is responsible for defining and governing data platforms. The role is primarily responsible for automating existing processes and bringing new ideas and innovation. The candidate is expected to code, conduct code reviews, and test frameworks as needed, along with participating in application architecture and design and other phases of automation. The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision.
Responsibilities:
- Design & Develop new automation framework for ETL processing
- Support existing framework and become technical point of contact for all related teams
- Enhance existing ETL automation framework as per user requirements
- Performance tuning of spark, snowflake ETL jobs
- New technology POC and suitability analysis for Cloud migration
- Process optimization with the help of automation and new utility development
- Work in collaboration for any issues and new features
- Support any batch issue
- Support application team teams with any queries
Required Qualifications:
- 7+ years of Data engineering experience
- Must be strong in UNIX Shell, Python scripting knowledge
- Must be strong in Spark
- Must have strong knowledge of SQL
- Hands-on knowledge on how HDFS/Hive/Impala/Spark works
- Strong in logical reasoning capabilities
- Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
- Strong collaboration and communication skills
- Must possess strong team-player skills and should have excellent written and verbal communication skills
- Ability to create and maintain a positive environment of shared success
- Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
- Good to have working experience on snowflake & any data integration tool i.e. informatica cloud
Primary skills: Python, Big Data & Apache Spark Desired skills
- Snowflake/Azure/AWS any cloud
- IDMC/any ETL tool
Pay Rate: $61 - $80
Job ID: 84092
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.