Data Engineer

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract W2
12 Months
No Travel Required
Remote
$50/hr
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Extract
  • Transform
  • Load
  • Computer Science
  • Conflict Resolution
  • Documentation
  • Communication
  • Data Engineering
  • Data Processing
  • Databricks
  • Analytical Skill
  • Apache Spark
  • Microsoft Azure
  • Microsoft SQL Server
  • Artificial Intelligence
  • Debugging
  • ELT
  • Information Technology
  • Migration
  • Optimization
  • Orchestration
  • Performance Tuning
  • Problem Solving
  • PySpark
  • SQL
  • Scalability
  • Amazon Web Services
  • Stored Procedures
  • Unity

Summary

Job Title: Databricks Data Engineer
Location: Remote
Employment Type: Contract
Job Summary
We are looking for an experienced Databricks Data Engineer with 7–8 years of overall IT experience to support a SQL Server to Databricks migration initiative. The ideal candidate will have strong expertise in Databricks, PySpark, Spark SQL, SQL Server migration, stored procedure conversion, notebook optimization, and query performance tuning. Exposure to Databricks AI features is a plus.
Required Skills
  • 7–8 years of overall IT experience with strong Data Engineering expertise
  • Hands-on experience with Databricks
  • Strong proficiency in PySpark and Spark SQL
  • Experience migrating workloads from SQL Server to Databricks
  • Experience converting SQL Server Stored Procedures into Databricks notebooks or PySpark code
  • Strong knowledge of SQL query optimization and Databricks notebook performance tuning
  • Experience with Delta Lake and modern data engineering practices
  • Strong ETL/ELT development experience
  • Excellent debugging and performance tuning skills
Preferred Skills
  • Experience with Azure Databricks, AWS, or Google Cloud Platform
  • Knowledge of Unity Catalog
  • Exposure to Databricks AI features such as MLflow, Mosaic AI, AI Functions, or Vector Search
  • Experience with Azure Data Factory, Airflow, or similar orchestration tools
Key Responsibilities
  • Migrate SQL Server workloads to Databricks.
  • Convert SQL Server stored procedures into scalable PySpark or Spark SQL solutions.
  • Optimize Databricks notebooks and Spark SQL queries for performance and scalability.
  • Design, develop, and maintain robust ETL/ELT data pipelines.
  • Work closely with architects and cross-functional teams to ensure a successful migration.
  • Troubleshoot and resolve data processing and performance issues.
  • Follow coding standards, best practices, and documentation guidelines.
Qualifications
  • Bachelor''s degree in Computer Science, Information Technology, or a related field.
  • 7–8 years of overall IT experience, including hands-on Data Engineering experience.
  • Strong communication, analytical, and problem-solving skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91126603
  • Position Id: 9036598
  • Posted 1 hour ago

Company Info

About Learn Beyond Consulting LLC

Our company was established with primary goal to deliver quality and cost effective IT consultancy and support to everyone who requires them.

Learn Beyond Consulting is a global consulting powerhouse. We are a team of high-skilled professionals who care about the level of information technology integration in modern business. As a team collectively We have more than 50 years of experience in IT industry..

We achieved our success because of how successfully we integrate with our clients. One complaint many people have about consultants is that they can be disruptive. Employees fear outside consultants coming in and destroying the workflow. Our clients face no such issues.

We believe in partnering, through close association with our clients to first understand and define what is truly needed, and then jointly work to create complete, customized business solutions tailored to their unique requirements.

Our methodology includes a very advanced approach to performance management ensuring the desired results are defined in clear measurable terms.

Our Vision is To provide Continuous Value Addition to our Clients by leveraging the Latest and most Innovative Technologies by Delivering Excellent Business Solutions.

We understand that each client has his own unique needs, definition of value, which must be sustained over a period of time as conditions and priorities change

Contact the job poster
SK

Sudeep Kumar

Recruiter @ Learn Beyond Consulting LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote or Bridgewater, New Jersey

Today

Easy Apply

Contract

50

Remote

2d ago

Easy Apply

Contract

Up to 50

Search all similar jobs