Hi,
The following requirement is open with our client.
Title : Databricks Data Engineer
Location : Charlotte, NC (Onsite)
Duration : 6+Months
Relevant Experience (in Yrs.): 6+
Looking for only W2
Job Description:
We are seeking a Databricks Data Engineer with 4–6 years of experience to design, develop, and support scalable cloud-based data engineering solutions. The ideal candidate will have strong expertise in Databricks, Apache Spark, SQL, Python or Scala, and Azure data platforms. The role involves building high-performance ETL/ELT pipelines, optimizing data processing, implementing Delta Lake solutions, and supporting production data environments. Candidates with Insurance/Brokerage domain experience and exposure to AI/ML or Agentic AI solutions on Databricks are highly preferred.
Key Responsibilities
· Design, develop, and deploy scalable ETL/ELT pipelines using Databricks, Apache Spark, and PySpark.
· Build and optimize SQL-based data transformation and analytics solutions.
· Develop Delta Lake architectures and enterprise data pipelines.
· Implement job orchestration, monitoring, data quality, and performance optimization.
· Maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows.
· Support Azure cloud data platforms and provide production support for reliable operations.
Required Skill
· Strong experience with Databricks and Apache Spark.
· Expertise in SQL, data analysis, and query optimization.
· Hands-on experience in ETL/ELT development and performance tuning.
· Experience with Python or Scala for data engineering.
· Knowledge of Azure cloud-based data platforms.
· Experience with Delta Lake, CI/CD, and production support.
· Excellent analytical, problem-solving, and communication skills.
Must Have Skill
· Databricks
· Apache Spark
· SQL
· Azure