VDart, Inc.
VDart, Inc.

Principal Data Engineer

Houston, TX, US • Posted 3 hours ago • Updated 3 hours ago
Contract Independent
Contract Corp To Corp
Contract W2
18 Months
No Travel Required
Able to Sponsor
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • Azure Databricks
  • Databricks Delta Live Tables (DLT)
  • Databricks Unity Catalog
  • Qlik Replicate
  • Azure Synapse Analytics
  • Azure Stream Analytics
  • SQL
  • Python
  • Scala
  • Spark SQL
  • Structured Streaming
  • ETL Pipelines
  • Data Lake Architecture
  • Data Governance
  • Cloud Data Migration

Summary

Principal Data Engineer

We are seeking an experienced Principal Data Engineer to lead the design, development, and implementation of scalable cloud-based data engineering and analytics solutions. The ideal candidate will have strong expertise in Microsoft Azure, Databricks, data lake architecture, data governance, and large-scale data processing. This role requires a combination of hands-on technical expertise, architecture capabilities, and technical leadership to drive data engineering initiatives, optimize performance, and ensure data quality and governance across enterprise environments.

Responsibilities

  • Architect, design, and implement scalable Azure-based data lake solutions.
  • Lead the development of data transformation pipelines using Databricks Delta Live Tables and Structured Streaming.
  • Establish technical roadmaps for data engineering capabilities using Qlik Replicate, Databricks, and Unity Catalog.
  • Optimize Databricks resources and workloads for high-volume data processing and cost efficiency.
  • Implement data governance, lineage, metadata management, and data quality standards using Unity Catalog.
  • Develop and optimize scalable ETL pipelines and data workflows.
  • Lead data migration initiatives from on-premises environments to cloud platforms and between cloud environments.
  • Monitor data pipeline performance and troubleshoot production issues.
  • Ensure compliance, security, and data governance best practices.
  • Collaborate with business and technical stakeholders to align data engineering initiatives with organizational objectives.
  • Provide technical leadership, mentor engineering teams, and facilitate knowledge-sharing sessions.

Requirements

<>Required Technical Skills
  • Strong expertise in Microsoft Azure data services.
  • Hands-on experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Databricks, Azure Stream Analytics, and Azure Synapse Analytics.
  • Advanced proficiency in SQL and programming languages such as Python, Scala, and Spark SQL.
  • Strong experience with Databricks Delta Live Tables and Structured Streaming.
  • Expertise in Databricks Unity Catalog, data governance, data lineage, and metadata management.
  • Experience with Qlik Replicate.
  • Strong understanding of data lake architecture and enterprise data engineering.
  • Experience designing and optimizing large-scale ETL pipelines.
  • Expertise in cloud data migration and performance optimization.
<>Preferred Qualifications
  • Bachelor's or Master's degree in IT, Computer Science, or a related discipline.
  • 15–17 years of overall IT experience.
  • Proven experience delivering enterprise-scale cloud data analytics solutions.
  • Azure Data Engineering or Databricks certifications are preferred.
  • Experience with Hadoop, Kafka, and Apache Spark.
  • Familiarity with Power BI or Qlik Sense.
  • Knowledge of AI/ML, NLP, and Generative AI concepts.
  • Experience working with Agile and Kanban methodologies.
<>Leadership & Communication Skills
  • Strong technical leadership and team management capabilities.
  • Excellent communication and stakeholder management skills.
  • Ability to translate complex technical challenges into business solutions.
  • Strong ownership, accountability, and problem-solving abilities.
  • Experience identifying technical risks and implementing mitigation strategies.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10330808A
  • Position Id: DENOV13
  • Posted 3 hours ago

Company Info

About VDart, Inc.

VDart, headquartered in Atlanta, GA, is a global leader in digital talent solutions and IT staffing, delivering top technology professionals to businesses worldwide. With a strong presence across North America, Europe and Asia, we specialize in helping organizations navigate complex technology landscapes with the right expertise.

Through a strategic, client-focused approach, we have placed over 20,000 professionals across key industries and advanced technology solutions. Whether placing top talent in cutting-edge roles or providing strategic digital workforce solutions, our network of 4,000 specialists across 13 countries is committed to excellence, agility and impact.

Backed by 18 years of industry experience, we go beyond staffing to build long-term partnerships that accelerate digital transformation and drive sustained growth. Whether you need a technology partner to fuel innovation or specialized workforce solutions to maintain a competitive edge, VDart delivers the right people, skills and mindset to create a lasting impact in a digital-first world.

Go to company profile
Contact the job poster
Vinay Kumar

Vinay Kumar

Executive Vice President (VDart Inc) @ VDart, Inc.

View Profile
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at VDart, Inc. in Houston, TX