Hi,
The following requirement is open with our client.
Title : Data Engineer – Azure Databricks (W2)
Location : Pleasanton, CA
Duration : 12+ Months
Relevant Experience (in Yrs.): 8+
Job Description:
· 8+ years of skilled Databricks Developer to design, develop, and optimize data pipelines and
analytics solutions using Databricks on cloud platforms (Azure/AWS/Google Cloud Platform).
· The ideal candidate will have strong experience in Spark, Python/Scala, and SQL, along with a solid understanding of big data processing and data engineering best practices
· Hands-on experience with Databricks and Apache Spark.
· Strong programming skills in Python and/or Scala.
· Proficiency in SQL for data manipulation and analysis.
· Experience with Delta Lake and Lakehouse architecture.
· Familiarity with cloud platforms (Azure Data Lake, AWS S3, or Google Cloud Platform).
· Knowledge of CI/CD pipelines and DevOps practices.
· Understanding of data modeling, data governance, and security.
· Experience with performance tuning for big data jobs.
· Roles & Responsibilities
· Design and implement ETL/ELT pipelines using Databricks and Apache Spark.
· Develop and optimize data workflows for large-scale data processing.
· Integrate data from multiple sources into data lakes and data warehouses.
· Collaborate with data architects and analysts to deliver scalable solutions.
· Implement data quality checks, monitoring, and performance tuning.
· Work with Delta Lake for ACID transactions and data versioning.
· Deploy and manage Databricks clusters and jobs. · Ensure compliance with security and governance standards. · Participate in Agile ceremonies and contribute to continuous
Must-Have Skills:
· Azure Databricks
· Python
· PySpark
· SQL
· Azure Cloud (ADLS & ADF)
Thanks and Regards,
Grace
Technical Recruiter |ASCII Group LLC.
Email: |Direct:
38345 W. 10 Mile Rd, Ste.#365; Farmington, MI 48335
Never miss an opportunity! Create an alert based on the job you applied for.
