Data Engineer

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
100% Travel

Skills

Spark
Java
scala
Bigdata

Job Details

  • Design, develop, test, deploy, and maintain scalable Big Data solutions.
  • Manage project priorities, deadlines, and deliverables across multiple initiatives.
  • Build and optimize data pipelines using Spark and other distributed processing

frameworks.

  • Develop software using modern programming languages such as Java or Scala.
  • Work with both relational (e.g., MySQL, Postgres) and NoSQL databases.
  • Integrate and manage data workflows using tools like Hive, Impala, OOZIE, Airflow,

NIFI, and Kafka.

  • Write shell scripts and manage deployments in Linux/Unix environments.
  • Collaborate with cross-functional teams in agile ceremonies including daily

stand-ups, story pointing, and retrospectives.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.