Overview
On Site
$50 - $60
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)
Skills
Agile
Amazon Web Services
Apache HBase
Apache Hadoop
Apache Hive
Apache Kafka
Apache Spark
Cloud Computing
Continuous Delivery
Continuous Integration
Data Warehouse
Databricks
Docker
Extract
Transform
Load
Good Clinical Practice
Google Cloud Platform
Kubernetes
Job Details
Job :Data Engineer with scala and spark
Location : NYC
Experience :8-9years
Skills :
Strong proficiency in Scala programming.
Solid hands-on experience with Apache Spark (Batch and/or Streaming).
Familiarity with Hadoop ecosystem, Hive, Kafka, or HBase.
Experience with SQL and data transformation logic.
Understanding of software engineering best practices (version control, CI/CD, testing).
Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus.
Experience with Delta Lake, Databricks, or Snowflake.
Familiarity with containerization and orchestration (Docker, Kubernetes, Airflow).
Experience working in an Agile environment.
Knowledge of data warehousing and ETL tools.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.