Data Engineer

Overview

On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Databricks
AWS

Job Details

Job Title: Sr. Data Engineer

Location: Columbia, SC (Onsite)

Duration: Long Term

Experience in cloud-based technologies; Preferred - AWS Cloud

Experience in Databricks;

AWS Cloud:
S3, Glue, PySpark, Lambda, RDS, RedShift, Athena, MSK, Data Firehose, App Flow, Apache Iceberg, State Machines, CDK, TypeScript, Cloud Watch, Cloud Formation, Lake Formation, AWS Terraform, AWS Sagemaker, AWS Sagemaker Unified Studio, Amazon Bedrock

Databricks:
Delta Lake, Unity catalog, Data Engineering and processing using Databricks

Nice to Have:

Hands-on experience administering Databricks workspaces, metastores, cluster policies, jobs, and serverless compute

Git Actions.
R Language.
R Studio / Posit Workbench.
R Shiny /Posit Connect.
Posit Package Manager.
AI and Machine Learning.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.