Data Engineer - Datanbricks

Remote • Posted 14 hours ago • Updated 37 minutes ago

Full Time

Remote

$150000/yr

Acunor Infotech

Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

Python
PySpark
Data engineer
databricks
data lake
Azure Databrick

Summary

Job Title: Data Engineer - Databricks

Location: Remote

Job Type: Full time

Job Overview:

We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for development and optimization of data pipelines, implementing robust data checks, and ensuring the accuracy and integrity of data flows. This role is critical in supporting data-driven decision-making processes, especially in the context of our insurance-focused business operations.

Key Responsibilities:

Develop and maintain scalable and efficient data pipelines to ensure seamless data flow across various systems adddress any issues or bottlenecks in existing pipelines.
Implement robust data checks to ensure the accuracy and integrity of data. Summarize and validate large datasets to ensure they meet quality standards.
Monitor data jobs for successful completion. Troubleshoot and resolve any issues that arise to minimize downtime and ensure continuity of data processes.
Regularly review and audit data processes and pipelines to ensure compliance with internal standards and regulatory requirements
Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc.

Qualifcation:

4-9 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.
Bachelor's degree in computer science, Information Technology, or related field.
Strong proficiency in PySpark, Python, SQL.
Strong experience in data modeling, ETL/ELT pipeline development, and automation
Hands-on experience with performance tuning of data pipelines and workflows
Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.
Experience with data modeling, ETL processes, Delta Lake and data warehousing.
Experience on Delta Live Tables, Autoloader & Unity Catalog.
Preferred - Knowledge of the insurance industry and its data requirements.
Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
Excellent communication and problem-solving skills to work effectively with diverse teams
Excellent problem-solving skills and ability to work under tight deadlines.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91026517
Position Id: 2026-1693
Posted 14 hours ago

Company Info

About Acunor Infotech

Acunor stands for Accurate North. Similar to North Star, we strive to provide accurate guidance and help our clients in every step of their journey towards a sustainable digital organization. Here at Acunor, we’ve been on a journey to upskill IT practitioners and we are ready to help IT organisations and individuals accelerate their upskilling journey and create the workforce of tomorrow, today.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer - Cybersecurity

Remote or Charlotte, North Carolina

•

Today

Data Engineer Location: Charlotte, NC (Remote Must work EST hours) Employment Type: Full-Time Role Overview We are seeking a Data Engineer to join the Information Security Data Operations team and contribute to the development of a Cybersecurity Data Lakehouse (CyberDW) platform. This role focuses on building and maintaining cloud-based data pipelines, ingestion frameworks, and data quality processes to support security analytics and enterprise data initiatives. The Data Engineer will collaborat

Easy Apply

Full-time

Databricks Architect

Remote

•

Today

Job Title: Databricks Architect Location: Remote Job Type: Full Time Role & Responsibilities Overview: Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.) Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring Continuously improve systems through performance enhancements and cost reductions in compute and storage Dat

Easy Apply

Full-time

$$150k

Search all similar jobs