Data Engineer with scala and Spark.

Overview

On Site
Depends on Experience
Full Time

Skills

Agile
Apache HBase
Apache Hadoop
Apache Hive
Apache Kafka
Apache Spark
Cloud Computing
Continuous Delivery
Continuous Integration
Data Warehouse
Databricks
Amazon Web Services
Extract
Transform
Load
Good Clinical Practice
Google Cloud Platform
Kubernetes
Microsoft Azure
Orchestration
SQL
Docker
Scala
Snow Flake Schema
Software Engineering
Streaming
Testing
Version Control

Job Details

Experience: 8-9 years

Strong proficiency in Scala programming.
Solid hands-on experience with Apache Spark (Batch and/or Streaming).
Familiarity with Hadoop ecosystem, Hive, Kafka, or HBase.
Experience with SQL and data transformation logic.
Understanding of software engineering best practices (version control, CI/CD, testing).
Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus.
Experience with Delta Lake, Databricks, or Snowflake.
Familiarity with containerization and orchestration (Docker, Kubernetes, Airflow).
Experience working in an Agile environment.
Knowledge of data warehousing and ETL tools.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.