Overview
Skills
Job Details
Role: Python + Hadoop
Location : (Charlotte, NC/ Chicago, IL /Denver, CO.) Local only
Onsite/hybrid: 5 Days Onsite
Years of Experience required : 7+ Yrs
Must Have skills: Python + Hadoop
Required Skills:
Strong SQL Skills - one or more of MS SQL, MySQL, HIVE, Impala, SPARK SQL
Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
Excellent Object oriented programming experience with Python
Experience with testing frameworks including pytest and python.unittest
Experience working with Kafka for streaming and HIVE (or equivalent) for historical storage
Bonus points for having experience working with one or more tech like: Hadoop/Big Data and Distributed Systems, SPARK Structured steaming, elastic
Performance tuning experience with Python and SQL jobs
Experience and proficiency with Linux operating system is a must
Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
Experience using Source Code and Version Control systems like Git, Bit Bucket etc.
Experience working with Jenkins and Jar management