Overview
Remote
On Site
$DOE
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - Long Term
Skills
Java
Python
SQL
T-SQL
Coding
Continuous Integration/Delivery
Apache
SDLC
Scripting
Object-Oriented
Data Pipelines
C++
Workflow Management
Apache Spark
Mysql
Scala
Big Data
Datasets
Unstructured Data
Job Details
Job Title: Senior Databricks Engineer
Long Term
Location : Remote
Job Description.
- 5-7 years industry experience coding commercial software and a passion for solving complex problems.
- 5-7 years direct experience in Data Engineering with experience in tools such as:
- Big data tools: Databricks, Apache Spark, Delta Lake, etc.
- Relational SQL (Preferably T-SQL. Alternatively pgSQL, MySQL).
- Data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc.
- Object-oriented/object function scripting languages: PySpark/Python, Java, C++, Scala, etc.
- Experience working with Data Lakehouse architecture and Delta Lake/Apache Iceberg
- Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases.
- Experience manipulating, processing, and extracting value from large, disconnected datasets.
- Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks.
- Experience manipulating structured and unstructured data.
- Experience architecting data systems (transactional and warehouses).
- Experience the SDLC, CI/CD, and operating in dev/test/prod environments.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.