Overview
Skills
Job Details
Solution IT Inc. is looking for Databricks Developer for one of its clients in REMOTE
Job Title: Databricks Developer
Summary:
We are looking for a Databricks Developer for some project support in Global Development
Required Skills
Apache Spark: Deep understanding of Spark's core concepts, performance optimization, and the ability to develop efficient data processing jobs.
Databricks data catalog: create tables from S3 and make them available in the unity catalog
Python, and SQL. Knowledge of R is a plus.
Hands-on experience with the Databricks platform, including Databricks SQL, Delta Lake, and Databricks Workspaces.
Experience with AWS and understanding how to integrate them with Databricks.
Version Control: Proficiency in using version control systems, such as Git, for code management and collaboration.
Great to haves-
DevOps and CI/CD: Understanding of DevOps principles and experience with CI/CD pipelines to automate testing and deployment of Databricks jobs.
Data Engineering Skills: Experience in designing and implementing scalable and reliable data pipelines, understanding of ETL processes, and familiarity with data modeling techniques.
Machine Learning and Data Science: Knowledge of machine learning algorithms and data science principles. Experience with MLflow for managing the machine learning lifecycle.
Work Site: REMOTE
Duration: 6+ Months
Expected Start Date: Immediate- 2 weeks
Number of Positions: 1
Please send your responses back to
About Solution IT
Solution IT is a national IT consulting company specializing in: Technology Staffing and Oracle E-Business Solutions based in Boston, Massachusetts.