Overview
On Site
$80-85/hr
Accepts corp to corp applications
Contract - W2
Contract - 12M+
Skills
AWS
DataBricks
ETL
RedShift
Delta Lke
Spark
Job Details
Senior ETL Databricks Developer Long Term Contract Foster City, CA
We are seeking a Senior ETL Databricks Developer to design and optimize high-performance data pipelines using Databricks on AWS. The role demands expertise in building scalable data solutions, leveraging modern data lake architectures, and integrating with advanced tools to support enterprise data workflows.
Key Responsibilities
- Design, develop, and optimize ETL data pipelines using Databricks and AWS.
- Implement and manage data lake solutions with Delta Lake for efficient storage and processing.
- Utilize Spark (Python/Scala) for large-scale data processing and performance tuning.
- Develop robust data models to support business requirements and analytics.
- Integrate CI/CD pipelines for automated data workflow deployments.
- Collaborate with cross-functional teams to integrate MLflow and other tools for enhanced data operations.
Required Skills and Experience
- Extensive experience with Databricks, Spark, and Delta Lake on AWS.
- Proficiency in Python and/or Scala for data pipeline development.
- Strong knowledge of modern data lake architectures and ETL frameworks.
- Expertise in data modeling and performance optimization for large-scale datasets.
- Hands-on experience with CI/CD for data workflows.
- Familiarity with MLflow for managing machine learning lifecycles.
Preferred Qualifications
- Experience with AWS cloud services (e.g., S3, Redshift, Glue).
- Knowledge of data governance and security best practices.
- Ability to work in a fast-paced, collaborative onsite environment.
Job Type: Contract
Duration: 12 M+ Extendable
Location: Foster City, CA
Work Type: Onsite
We are an AI-first leader in full-stack product and platform engineering services. We leverage advanced technologies such as Data and Cloud Engineering integrated with AI to help our clients scale, innovate, transform their businesses in the digital age and realize business value with better customer experience.
Right Skale Inc, headquartered in Pleasanton, CA, is an emerging global product development and platform engineering company.
With a focus on digital transformation and cloud computing, we provide end-to-end technology solutions and services from strategy, architecture, and consulting to software development.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.