Big Data Engineer

sql, big data, spark, devops, AWS, deep learning, kafka, cassandra, Airflow, Argo, Luigi, data engineering, data engineer, h-base, redis
Full Time, Fulltime

Job Description

  • Bachelor's degree or higher in Computer Science or closely related field
  • 4 years of experience using "big data" technologies
  • 2+ years of experience in design and implementing AWS Cloud Solutions at enterprise level
  • Experience with functional or object-oriented languages such as Python, C++, REST, Scala
  • Handson experience on Complex SQl queries
  • Experience with Airflow, Argo, Luigi, or similar orchestration tool
  • Experience performing root cause analysis on Spark jobs to identify areas for improvement
  • Experience with No-SQL databases such as HBase, Cassandra, or Redis.
  • Experience with streaming technologies such as Kafka, Flink, or Spark Streaming
  • Experience with DevOps principals and CI/CD; and Containers and Kubernetes

Posted By

Karishma Huddar

Dice Id : 90977021
Position Id : 2020-261
Originally Posted : 2 weeks ago
Have a Job? Post it

Similar Positions

Data Engineer
  • Zai Global
  • Chicago, IL
Big Data Engineer
  • Spout IT
  • Schiller Park, IL
Data Engineer
  • The Judge Group, Inc.
  • Schaumburg (township), IL
Data Engineer
  • Net2Source Inc.
  • Chicago, IL
Data Engineer- Kafka Spark Scala
  • Royal Cyber
  • Rolling Meadows, IL
Senior Data Engineer - REMOTE
  • Craft Recruiting
  • Chicago, IL
Data Engineer
  • Multivision Inc-IL
  • Elmhurst, IL
Data Engineer
  • Chicago, IL
Data Engineer (AWS)
  • Connect Search LLC
  • Chicago, IL
Cloud Data Engineer
  • BDO Digital
  • Oak Brook, IL
Data Engineer
  • MATRIX Resources, Inc.
  • Chicago, IL
Azure Data Engineer
  • Photon Infotech
  • Chicago, IL
Data Engineer
  • Signature Consultants
  • Chicago, IL
Spark AWS Data Engineer
  • Keylent
  • Chicago, IL