Data Engineer

Overview

Accepts corp to corp applications
Contract - W2
Contract - Independent

Skills

Python
Amazon Web Services
User Experience Design
Best Practices
HANA
data modeling
SQL
Power BI
marketing
ETL
data quality
USE Cases
Usability
Microsoft Dynamics
CRM
Database Modeling
Data Migration
GCP
Data Governance
Tableau Software
Business Intelligence
Data Pipelines
Master Data Management
Data Structures

Job Details

Data Engineers

Location: San Jose, ( Hybrid: Tues, Wed, Thurs- in Office)

Overview:

We are seeking a highly skilled Data Engineer with strong expertise in Databricks to lead the design and execution of scalable data pipelines and architectures. This role sits at the intersection of Customer Analytics, Master Data Management (MDM), and Generative AI/LLMs. The ideal candidate also brings experience building custom applications, supporting BI integration, reverse ETL workflows, and applying user experience design principles to internal tools.

Key Responsibilities:

  • Design, develop, and optimize advanced data pipelines using Databricks (SQL, Python, Spark, Delta Lake).
  • Integrate and structure customer and enterprise data across systems to support analytics, AI, and MDM initiatives.
  • Build and maintain custom internal applications and services that support data workflows and operational teams.
  • Develop and refine prompts and workflows for LLM-based and generative AI use cases.
  • Collaborate with MDM teams to support identity resolution and golden record management.
  • Enable analytics delivery through Power BI, Tableau, and other BI tools.
  • Replicate data from sources to targets via Fivetran
  • Use reverse ETL tools like Census to replicate enriched data back into CRM and marketing systems.
  • Apply user experience design principles to internal data tools, dashboards, and interfaces to improve usability and adoption.
  • Ensure high data quality, reliability, and performance across the data stack.

Required Qualifications:

  • Extensive hands-on experience with Databricks (Spark, Delta Lake, Lakehouse architecture, notebooks, orchestration).
  • 3+ years of experience in data engineering, full-stack development, or a related field.
  • Strong proficiency in SQL and data modeling best practices.
  • Solid understanding of customer data structures, MDM concepts, and data governance.
  • Experience working with generative AI and LLMs, including prompt engineering and AI-assisted workflows.
  • Experience developing and deploying custom applications, APIs, or internal tools.
  • Proficiency in cloud environments (Azure, AWS, or Google Cloud Platform).

Preferred Qualifications:

  • Familiarity with Power BI, Tableau, and other business intelligence tools.
  • Experience using Census or similar reverse ETL platforms.
  • Background supporting marketing, sales, or customer experience analytics initiatives.
  • Awareness of UX design best practices, especially when building internal tools or data interfaces.
  • Strong collaboration and communication skills with both technical and business stakeholders.

Hiring Mgr is looking for candidate with exp-

Data migration from Hana to AZURE using Databricks

MS Dynamics knowledge/ exp.

Knowledge of Hana ( SQL db) , atleast basics of new generation data housre (data lake) eg Databricks .

Good understanding ETL pipelines ( ETL Tools / Reverse ETL tools : Snaplogic, Fivetran, Sensus, Hana)

Reporting dashboards.

BI tech, Analytics experience in general.

AI workflows ( Most of Gen AI algorithms based on Gen AI). May not necessarily work on AI tech, but need to know basis AI)

Databricks - exp Administration, Build pipelines, high level expertise

Azure experience

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.