Overview
Remote
$70 - $100
Contract - Independent
Contract - W2
Contract - 12 Month(s)
Skills
Databricks
Spark
Python
SQL
Azure Data Services
Git/CI-CD
Data Lakehouse
Delta Lake
Large-scale ETL Pipelines
Data Governance.
Job Details
Position Description:
Client: Federal Government
Job Title: Databricks Engineer
Location: Remote
Duration: 11+ Months
Experience Level: 10+ Years
Required Skills and Experience:
Technical Expertise:
- 3 5 years of hands-on experience with Databricks, including Spark-based data processing and orchestration.
- Proficiency in configuring and managing Azure services to support data platforms, including provisioning resources, implementing security controls, and optimizing performance for data storage
- Strong programming and scripting skills in Python for data manipulation, pipeline creation, and automation.
- Advanced skills in SQL for data analysis, querying, and performance tuning.
- Experience using Git (i.e., GitHub) and CI/CD pipelines for managing data solutions and version control.
Project Experience:
- Proven ability to integrate systems, automate workflows, and manage large data volumes ranging from structured to unstructured datasets.
Soft Skills:
- Strong communication skills to work with diverse teams, including developers, architects, and business stakeholders.
- Problem-solving and troubleshooting abilities within complex data environments.
- Demonstrated ability to deliver projects on time, meeting specified technical and business requirements.
Preferred Skills:
- Experience with Delta Lake architecture (used with Databricks) for efficient transaction handling and ACID compliance.
- Experience working on data lakehouse implementations in an enterprise IT environment.
- Demonstrated ability to work on projects involving large-scale ERP platforms (e.g., Oracle).
- Knowledge of data governance practices, including data security, access control, and cataloging.
Certifications such as:
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified Data Engineer Associate or Professional
Familiarity with ERP-related data requirements, such as financial transaction data, supply chain data, or master data management
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.