Databricks Data/ETL Developer
SmallArc, Inc
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Data Modeling
- Data Lake
- Extract, Transform, Load
- Continuous Delivery
- Databricks
- Data Engineering
Summary
Required Skills:
Good customer presence and ability to answer a variety of Databricks questions
• GitHub and CI/CD experience is a plus Day-to-day Responsibilities:
• Design, develop, and maintain data engineering pipelines in Databricks using PySpark or SQL
• Experience developing streaming pipelines using Databricks Autoloader or Structured Streaming
• Data Modeling experience designing Delta Lake tables and the Bronze-Silver-Gold Medallion Architecture
• Understanding of Spark for performance optimizations including Delta Lake optimizations
• Experience with cloud service provider (Azure) services used in Databricks’ implementations (e.g., Azure ALDS, IAM)
• Triaging ad hoc questions across the Databricks product suite Certifications
Preferred Skills:
FiveTran Responsibilities: Support ETL and CI/CD pipelines to create tables in the data lake. Support data refresh and reconciliation processes to validate data accuracy. Expected Deliverable(s): Data pipelines, tables, row-level security configurations, and ETL processes to automatically update datasets daily
- Dice Id: 10115873
- Position Id: 9137582
- Posted 1 hour ago
Company Info
Our firm was established back in 2000 by a group of consultants with a strong focus on delivering quality services to our clients from the perspective of those who worked in the field. Because of the huge amount of industry experience behind us, we knew that we could provide our clients with a no gimmicks, truly valuable set of solutions that exactly matched all of their IT needs.
In today’s digital world, we’re surrounded by information at all times. The purpose of SmallArc is to provide a cohesive set of information management solutions that organize, optimize and present information in an efficient and informative way.
SmallArc is a premier consulting firm specializing in Business Intelligence, Data Warehousing, and Data Integration. We provide end-to-end services from Data Architecture, Implementation, Project Management, Long Term Support, and Training.
We provide you with a competitive advantage which is derived from our extensive team of business intelligence experts. We recruit and employ only the best and brightest to ensure the highest level of knowledge and competence. We provide you with the most innovative, reliable, and consistent results on every project — no matter the scope or scale. We have earned a solid reputation for client success due to our unique ability to deliver business intelligence solutions on time, and under budget.
