Senior Data Specialist - R01565550

• Posted 3 days ago • Updated 3 minutes ago

Full Time

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Python
PL/SQL
Transact-SQL
Stored Procedures
Analytics
Real-time
Optimization
Management
Data Quality
Caching
Collaboration
Migration
PySpark
SQL
Data Warehouse
Orchestration
Data Modeling
Extract
Transform
Load
ELT
SCD
Cloud Computing
Amazon Web Services
Amazon S3
Electronic Health Record (EHR)
Microsoft Azure
ADF
Workflow
Version Control
Git
Continuous Integration
Continuous Delivery
Apache Kafka
Apache Spark
Streaming
Snow Flake Schema
Amazon Redshift
Unity
Data Engineering
Databricks
Soft Skills
Problem Solving
Conflict Resolution
Analytical Skill
Agile
Communication
Stakeholder Management
Artificial Intelligence
Innovation

Python
PL/SQL
Transact-SQL
Stored Procedures
Analytics
Real-time
Optimization
Management
Data Quality
Caching
Collaboration
Migration
PySpark
SQL
Data Warehouse
Orchestration
Data Modeling
Extract
Transform
Load
ELT
SCD
Cloud Computing
Amazon Web Services
Amazon S3
Electronic Health Record (EHR)
Microsoft Azure
ADF
Workflow
Version Control
Git
Continuous Integration
Continuous Delivery
Apache Kafka
Apache Spark
Streaming
Snow Flake Schema
Amazon Redshift
Unity
Data Engineering
Databricks
Soft Skills
Problem Solving
Conflict Resolution
Analytical Skill
Agile
Communication
Stakeholder Management
Artificial Intelligence
Innovation

Summary

Lead Data Engineer
Primary Skills

ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures

Specialization

Databricks Engineering: Data Engineer

Job requirements

Job Description - Data Engineer (Databricks)

Company: Brillio Technologies
Role: Data Engineer - Databricks
Experience: 5-10 Years
Location: India (Hybrid/3 days)
Employment Type: Full-time

About Brillio

Brillio is a leading digital transformation partner delivering innovative solutions across Data, Cloud, AI, and Digital Engineering. We help global enterprises unlock value through cutting-edge technology and data-driven insights.

Role Overview

We are looking for a hands-on Data Engineer with strong Databricks expertise to design, build, and scale modern data platforms. The ideal candidate will have experience in PySpark, Delta Lake, and cloud-native data engineering and will work closely with analytics, product, and business teams to deliver high-performance data pipelines.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks and PySpark
Build and optimize data lakehouse architectures (Bronze-Silver-Gold layers)
Develop data ingestion frameworks from multiple sources (batch & real-time)
Implement Delta Lake features including schema evolution, ACID transactions, and optimization
Create and manage Databricks notebooks, workflows, and jobs for production pipelines
Ensure data quality, governance, and lineage across pipelines
Optimize Spark jobs for performance (partitioning, caching, tuning)
Collaborate with cross-functional teams (Data Scientists, Analysts, Architects)
Support production deployments, monitoring, and troubleshooting of data pipelines
Contribute to migration of legacy data platforms to modern cloud-based architecture

Technical Skills (Must-Have)

Strong experience in:

Databricks (Workflows, Notebooks, Jobs)
PySpark / Spark SQL
SQL & Data Warehousing concepts

Hands-on experience with:

Delta Lake / Lakehouse architecture
Data pipeline development & orchestration

Good understanding of:

Data modeling, ETL/ELT processes, SCD concepts

Cloud & Tools

Experience in at least one:

AWS (S3, Glue, EMR) / Azure (ADF, ADLS, Synapse)

Workflow tools:

Airflow / Databricks Workflows

Version control:

Git / CI-CD pipelines

Good to Have

Experience with:

Streaming frameworks (Kafka / Spark Streaming)
DBT / Snowflake / Redshift / Fabric

Exposure to:

Unity Catalog, Autoloader, Delta Live Tables

Experience Required

5-10 years of experience in Data Engineering
Minimum 2-4 years of hands-on Databricks experience
Proven experience building enterprise-scale data platforms and pipelines

Soft Skills

Strong problem-solving and analytical skills
Ability to work in a fast-paced, agile environment
Good communication and stakeholder management

Why Join Brillio

Work on cutting-edge data & AI programs
Opportunity to build large-scale data platforms
Collaborative and innovation-driven culture

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90672149
Position Id: dac84bbea5ca2ad2dfd71c0c2c44a739
Posted 3 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Los Angeles, California

•

Today

Job Description Location: Los Angeles, CA Onsite/ Hybrid/ Remote: Hybrid (Once a week onsite) Duration: 12 Months Rate Range: Upto $89/hr on C2C or $82/hr on W2 Work Authorization: All valid EADs except H1B, OPT, CPT Must Have: Databricks and Snowflake for data platformsSpark or PySpark with Python for batch processingAdvanced SQL with query tuning, partitioning, clusteringData modeling using star, snowflake, SCD, OBT, normalized modelsExperience with Medallion architectureData ingestion p

Full-time

USD 89.00 per hour

Data Engineer

Plano, Texas

•

Today

Ascentt is transforming the future of manufacturing through advanced Data Analytics, AI/ML, and Generative AI solutions. We partner with global manufacturing enterprises to convert complex industrial data into actionable, real-time business insights. Our teams work on scalable, high-impact engineering challenges across cloud, data, and intelligent automation ecosystems. If you are passionate about innovation, solving complex problems, and building next-generation data platforms, Ascentt offers a

Full-time

Data Engineer

Irvine, California

•

Today

Many structural heart patients suffer from heart failure with limited options. Our Implantable Heart Failure Management (IHFM) team is at the forefront of addressing these unmet patient needs through pioneering technology that enables early, targeted therapeutic intervention. Our innovative solutions are not just transforming patient care but also creating a unique and exciting environment for our team members. It's our driving force to help patients live longer and healthier lives. Join us and

Full-time

USD 87,000.00 - 123,000.00 per year

Senior Data Engineer

Chicago, Illinois

•

Today

The Senior Data Engineer will design, build, and maintain the scalable data pipelines, models, and infrastructure that power analytics, business intelligence, and machine-learning products across the company. Partnering closely with business, product, and analytics teams, you will translate complex requirements into elegant, reliable data solutions and help drive the delivery of innovative data products. This role reports to the Senior Manager, Data Engineering. Build E2E Azure Databricks-based

Full-time

USD 148,000.00 - 164,000.00 per year

Search all similar jobs

Senior Data Specialist - R01565550

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs