Lead Data Engineers - Azure/ Databricks/ Snowflake

• Posted 4 days ago • Updated 8 hours ago
Full Time
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Sales
  • Software Management
  • Global Delivery
  • Data Structure
  • Apache Spark
  • Scala
  • ELT
  • ADF
  • Python
  • Snow Flake Schema
  • SQL
  • Data Processing
  • Agile
  • Science
  • Information Technology
  • Databricks
  • Data Storage
  • Data Lake
  • SQL Azure
  • Database
  • Collaboration
  • Data Quality
  • Workflow
  • Scalability
  • Data Integration
  • DevOps
  • Continuous Integration
  • Continuous Delivery
  • Data Engineering
  • Data Governance
  • Communication
  • Analytical Skill
  • Problem Solving
  • Conflict Resolution
  • Big Data
  • Organized
  • Organizational Skills
  • Microsoft Excel
  • Microsoft PowerPoint
  • Microsoft Azure
  • Kubernetes
  • Cosmos-Db
  • Streaming
  • Google Cloud
  • Google Cloud Platform
  • API
  • React.js
  • Cloud Computing
  • Artificial Intelligence
  • Machine Learning (ML)
  • Data Warehouse
  • Extract
  • Transform
  • Load
  • Storage
  • Business Data
  • Reporting
  • Software Development
  • Software Development Methodology
  • Data Analysis
  • Management
  • IT Consulting
  • Data Management
  • Analytics
  • Leadership
  • Finance
  • Revenue Growth
  • Publications
  • Innovation
  • IT Service Management
  • Telecommunications
  • Health Care
  • Entrepreneurship

Summary

About The Position

Lead Data Engineers - Azure/ Databricks/ Snowflake

Department: Sales and Delivery Team - Empower

Industry: Information Technology & Services, Computer Software, Management Consulting


Experience Range: 6 - 14 years

Basic Qualification: Bachelor of Engineering or Equivalent

Travel Requirements: Not required

Website:

Exusia, a cutting-edge digital transformation consultancy, and is looking for top Talent in Azure, Databricks Snowflake Data Warehouse Application Developers to join our global delivery team's Industry Analytics practice in India.

What's the Role?

Full-time job to work with Exusia's clients to design and develop the system components for the extract and transform or conversion of data from various source systems to the target applications; Create data structures or data models that support data across all stages of the extract, transform and load process. Should have good hands on experience in implementing the parallel and sequence jobs using Snowflake and or or Azure or Databricks or Spark or Scala. Analyzing, developing, monitoring and administration of the ETL process using any tool. Experience working with on-shore/off-shore delivery model is a big plus.

The Lead Data Engineer will implement monitoring solutions, optimize ETL jobs for performance, and provide comprehensive support from data ingestion to final output. With in-depth knowledge of the Databricks platform and strong analytical skills, this position will significantly enhance the department's ability to deliver high quality, data-driven insights and solutions.

Criteria for the Role!

Have a minimum of 6+ years' experience working as a Azure Databricks Developer in to a data analytics domain

Azure Databricks Specific

4+ years of experience in Azure services and in Databricks (ADLS, ADF, DevOps, etc.)

10+ years of experience in designing and implementing ETL/ELT pipelines using ADF, integrating with other Azure services.

7+ years of Python development experience. Should have capability of developing own libraries

4+ years of experience in Snowflake or SQL experience (No-SQL experience is a plus)

Experience designing, building, and maintaining data processing systems

Experience with or knowledge of Agile Software Development methodologies

Education Qualification - Bachelor of Science (preferably in Computer and Information Sciences or Business Information Technology) or an Engineering degree in the above areas

Responsibilities:

Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Databricks

Build and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Cosmos DB or Vector DB

Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.

Implement data quality checks, data governance, and security best practices across data platforms.

Monitor, troubleshoot, and optimize data workflows for performance and scalability.

Automate data integration and transformation processes using Azure DevOps and CI/CD pipelines.

Stay up-to-date with emerging Azure technologies and data engineering trends.

Deep understanding of data management, data governance, cloud and AI technologies, and their application in a business context.

Excellent problem solving and troubleshooting skills

Excellent oral and written communication skills

Strong analytical and problem-solving skills

Data experience working with multiple, large datasets / big data

Demonstrated experience in effectively working with multiple projects and activities in a timely, organized manner

Demonstrated experience in organizing and prioritizing work, meeting deadlines and working independently as well as collaboratively with others

Experience with Excel and PowerPoint.

Requirements

Nice - to - have Skills:

2+ years of experience with Azure stack example Azure Kubernetes Service (AKS), Cosmos DB

Understanding on cloud streaming technique Google Cloud Platform, Snowpipe

Experience in designing API development and integrating with React JS within cloud platform

Leverage modern technologies, such as AI and ML

Must have strong DWH and ETL basics

Should have basic loud knowledge - Storage and Compute

Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics domain

Document, discuss and resolve business, data and reporting issues within the team, across functional teams, and with business stakeholders

Support all phases of the software development lifecycle (SDLC)

Present written and verbal data analysis findings, to both the project team and business stakeholders

Manage changing priorities and work on multiple projects concurrently

Be self-motivated and proactive in a fast-paced environment and flexible to work

About Exusia

Exusia ( ) is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business objectives and providing strategy and solutions in data management and analytics. The company has established its leadership position by solving some of the world's largest and most complex data problems in the financial, healthcare, telecommunications and high technology industries.

Exusia's mission is to transform the world through the innovative use of information.

Exusia was recognized by Inc. 5000 and by Crain's publications as one of the fastest growing privately held companies in the world. Since the company's founding in 2012, Exusia has experienced an impressive seven years of revenue growth and has expanded its operations in the Americas, Asia, Africa and UK. Exusia has recently also been recognized by publications such as the CIO Review, Industry Era, Insight Success and the CIO Bulletin for the company's innovation in IT Services, the Telecommunications and Healthcare industries and its entrepreneurship. The company is headquartered in Miami city of Florida, United States with development centers in Pune, Hyderabad, Bengaluru and Gurugram, India.

Interested applicants should apply by forwarding their CV to:
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 80184323
  • Position Id: 5f3634c0eb325183a4d275814ad002cc
  • Posted 4 days ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Houston, Texas

Today

Full-time

Charlotte, North Carolina

20d ago

Easy Apply

Contract

Depends on Experience

Remote

25d ago

Easy Apply

Contract

0+

Miami, Florida

Today

Easy Apply

Full-time

Depends on Experience

Search all similar jobs