Databricks Data Engineer

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract W2
24 Months
No Travel Required
Remote
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Databricks

Summary

 
Position: Databricks Engineer
Location: Remote
 
 
Job Description

 

Must Have Technical/Functional Skills
  • 8+ years of experience in Data Engineering, ETL/ELT, and Data Warehousing.
  • 5+ years of hands-on experience with Databricks, PySpark, and Apache Spark.
  • Strong expertise in Delta Lake, Lakehouse Architecture, and large-scale data processing.
  • Advanced SQL and PL/SQL development skills.
  • Experience designing and implementing scalable batch and real-time data pipelines.
  • Strong knowledge of dimensional, relational, and analytical data modeling.
  • Experience with Spark SQL, DataFrames, Hive, and distributed computing frameworks.
  • Hands-on experience with AWS services, including S3, IAM, Glue, Lambda, and Redshift.
  • Strong understanding of Databricks-AWS integrations and cloud-native architectures.
  • Experience with data quality, performance tuning, optimization, and troubleshooting.
  • Knowledge of CI/CD, Git, DevOps practices, and deployment automation.
  • Excellent analytical, problem-solving, communication, and stakeholder management skills.
  • Prior experience leading technical teams and mentoring junior engineers.
Roles & Responsibilities
  • Gather and analyze business and technical requirements from stakeholders and clients.
  • Design end-to-end data solutions, architectures, and scalable data models.
  • Develop and optimize data ingestion, transformation, and analytics pipelines using Databricks and PySpark.
  • Create and maintain conceptual, logical, and physical data models.
  • Lead solution design activities, including High-Level and Low-Level Design documentation.
  • Implement data quality, monitoring, governance, and performance optimization best practices.
  • Collaborate with Product Owners, Architects, and Business Analysts to define project scope and delivery plans.
  • Provide technical leadership, mentoring, and guidance to onshore and offshore teams.
  • Conduct design reviews, code reviews, and troubleshooting sessions to ensure solution quality.
  • Drive continuous improvements in platform performance, scalability, reliability, and cost optimization.
  • Support production deployments, issue resolution, and root cause analysis activities.
  • Contribute to technology roadmaps and recommend innovative solutions aligned with business goals.
TCS Employee Benefits Summary:
  • Discretionary Annual Incentive.
  • Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
  • Family Support: Maternal & Parental Leaves.
  • Insurance Options: Aut& Home Insurance, Identity Theft Protection.
  • Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
  • Time Off: Vacation, Time Off, Sick Leave & Holidays.
  • Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

 

 
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91162152
  • Position Id: 9142980
  • Posted 1 hour ago

Company Info

About Cosmic-I LLC DBA Northern Base

Enabling our clients to achieve their goals since 2016.

We stay at the forefront of technology trends and emerging innovations to bring our clients cutting-edge solutions that help them stay ahead of the competition. Our focus on innovation enables us to provide customized IT solutions that address our clients’ specific needs and drive business success.

About_Company_One
Contact the job poster
RL

Ramya Lakshmi

Recruiter @ Cosmic-I LLC DBA Northern Base

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.