Big Data Solutions Engineer (streaming / batch processing)

Amazon Web Services, Apache Flink, Apache Hive, Apache Spark, Batch processing, Big data, Communication skills, Engineering, Infrastructure, Java, Open source, Python, Scala, Streaming, Software development, Machine learning, Real-time, Jupyterhub
Contract W2, Contract Corp-To-Corp, 6 Months
Depends on Experience
Work from home available Travel not required

Job Description

Solutions Engineer (2 positions)

  • Minimum 10+ years of experience, with 5+ years of experience designing and implementing batch or real-time data pipelines; Must have expertise in either batch processing or real time streaming
  • Hands-on experience on batch processing (JupyterHub, Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)
  • Experience in AWS and knowledge in its ecosystem
  • Excellent communication skills is a must, experience working with customers directly to explain how they would use the infrastructure to build complex data pipelines
  • Proven ability to work in an agile environment, flexible to adapt to changes
  • Able to work independently, research on possible solutions to unblock customer
  • Programming experience in Scala, Java, or Python
  • Fast learner and experience with other common big data open source technologies is a big plus
  • Knowledge on machine learning (Client) is a nice-to-have
Dice Id : artech
Position Id : 6765654
Originally Posted : 2 months ago
Have a Job? Post it