Data Engineer

Overview

On Site
USD55 - USD65
Contract - W2

Skills

Data Engineer

Job Details

job summary:


  • Strong SQL Skills - one or more of MS SQL, MySQL, HIVE, Impala, SPARK SQL
  • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
  • Excellent Object oriented programming experience with Python



location: Charlotte, North Carolina

job type: Contract

salary: $55.06 - 65.06 per hour

work hours: 8am to 5pm

education: Bachelors



responsibilities:


  • Experience with testing frameworks including pytest and python.unittest
  • Experience working with Kafka for streaming and HIVE (or equivalent) for historical storage
  • Bonus points for having experience working with one or more tech like: Hadoop/Big Data and Distributed Systems, SPARK Structured steaming, elastic
  • Performance tuning experience with Python and SQL jobs


qualifications:


  • Experience and proficiency with Linux operating system is a must
  • Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
  • Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
  • Experience using Source Code and Version Control systems like Git, Bit Bucket etc.
  • Experience working with Jenkins and Jar management
  • Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets


skills:

  • Required Skills:
  • Strong SQL Skills - one or more of MS SQL, MySQL, HIVE, Impala, SPARK SQL
  • Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
  • Excellent Object oriented programming experience with Python
  • Experience with testing frameworks including pytest and python.unittest
  • Experience working with Kafka for streaming and HIVE (or equivalent) for historical storage
  • Bonus points for having experience working with one or more tech like: Hadoop/Big Data and Distributed Systems, SPARK Structured steaming, elastic
  • Performance tuning experience with Python and SQL jobs
  • Experience and proficiency with Linux operating system is a must
  • Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
  • Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
  • Experience using Source Code and Version Control systems like Git, Bit Bucket etc.
  • Experience working with Jenkins and Jar management
  • Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
  • Ability to comprehend customer requests and provide the correct solution
  • Strong analytical mind to help take on complicated problems
  • Desire to resolve issues and dive into potential issues
  • Ability to adapt and continue to learn new technologies is important




Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.