Overview
Skills
Job Details
Python + Hadoop
Position: Contract (W2)
Location: Charlotte, NC/ Chicago, IL /Denver, CO
Duration: 12 Months
Job description:
Strong SQL Skills - one or more of MS SQL, MySQL, HIVE, Impala, SPARK SQL
Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
Excellent Object oriented programming experience with Python
Experience with testing frameworks including pytest and python. Unit test
Experience working with Kafka for streaming and HIVE (or equivalent) for historical storage
Bonus points for having experience working with one or more tech like: Hadoop/Big Data and Distributed Systems, SPARK Structured steaming, elastic
Performance tuning experience with Python and SQL jobs
Experience and proficiency with Linux operating system is a must
Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
Experience using Source Code and Version Control systems like Git, Bit Bucket etc.
Experience working with Jenkins and Jar management
Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
Ability to comprehend customer requests and provide the correct solution
Strong analytical mind to help take on complicated problems
Desire to resolve issues and dive into potential issues
Ability to adapt and continue to learn new technologies is important