Data Engineer

Scalable Systems, Python, ETL, AWS, SQL, Linux, APIs, Apache Kafka, Spark, MySQL, Scala
Contract W2, 12 Months
Depends on Experience

Job Description

Our client is looking for a Data Engineer to join the team and play a critical role in the design and implementing of sophisticated data pipelines and real time analytics streams that serve as the foundation of their data platform. Candidates should have the following qualifications -

  • College degree in a technical area (Computer Science, Information Technology, Mathematics or Statistics)
  • 8+ years’ experience as a data engineer designing and implementing data pipelines
  • In depth experience with Python (including Jupyter notebooks, Conda, Pandas, and/or Cython), Spark, and Scala
  • Experience with big data infrastructure to support data science on Linux based systems
  • Experience with big data tools, data pipelines, databases, cloud services, and Python
  • Experience building modular, scalable, cloud-based system infrastructure
  • Knowledge of the ETL process and patterns of real time data products
  • Knowledge of SQL
  • Experience with AWS services such as EC2, S3, EBS, Glacier, and RDS
  • Ability to allocate and utilize AWS resources
  • Experience integrating with diverse APIs
  • Work closely with data scientists on the data demand side
  • Work closely with domain experts and data source owners on the data supply side
  • An ability to build a data pipeline monitoring system with robust, scalable dashboards and alerts for 24/7 operations
  • Experience with Apache Kafka, Spark, Ignite and/or Redis
  • Working knowledge of MySQL
  • Experience with node.js and PHP
Dice Id : solpart
Position Id : 6695781
Originally Posted : 1 month ago
Have a Job? Post it

Similar Positions

Google Cloud Platform Data Engineer
  • Thoughtwave Software and Solutions
  • Chicago, IL
Azure Data Engineer
  • Scalable Systems
  • Chicago, IL
Sr. Data Engineer
  • Green Key Resources
  • Chicago, IL
Manager, IT Data Engineering
  • Kraft Heinz
  • Chicago, IL
Senior Data Engineer with AWS and Spark
  • enableIT LLC
  • Chicago, IL
Azure Data Engineer
  • Spout IT
  • Chicago, IL
Data Engineer
  • Solution Partners, Inc.
  • Naperville, IL