Data Lead Engineer

Fremont, CA, US • Posted 1 day ago • Updated 1 day ago
Contract Corp To Corp
Contract Independent
Contract W2
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

  • ADF
  • SQL Azure
  • SQL
  • Oracle
  • Python
  • Real-time
  • SLA
  • HDFS
  • Health Care

Summary

Mandatory Skills:

Azure Data Factory (ADF), Azure Databricks & PySpark, Azure Synapse, Azure SQL, Python, and Spark SQL

Job Description:

  • Accomplished Data Architect / Senior Data Engineer with 12+ years of experience designing and modernizing
  • enterprise data platforms across banking, healthcare and retail domains
  • Architected scalable ETL/ELT pipelines using Python, PySpark, Databricks, AWS Glue and Azure Data Factory,
  • supporting high-volume transactional and regulatory data processing.
  • Led enterprise-scale Data Architecture initiatives, defining logical and physical data models, governance
  • standards and cloud-native platform blueprints across AWS and Azure environments.
  • Designed and implemented Medallion (Bronze/Silver/Gold) Lakehouse architectures using Delta Lake, S3, ADLS
  • Gen2, Snowflake, Redshift and Synapse Analytics.
  • Engineered large-scale distributed processing workloads using Apache Spark, PySpark, Databricks, EMR, Hive
  • and HDFS, processing billions of records for enterprise analytics.
  • Orchestrated complex data workflows using Apache Airflow, Databricks Workflows, AWS Step Functions and
  • Azure Data Factory triggers, ensuring SLA-driven pipeline execution.
  • Strong hands-on experience in Advanced SQL, including complex joins, CTEs, window functions, stored
  • procedures, indexing strategies, partitioning and execution plan optimization across Snowflake, PostgreSQL
  • and Oracle.
  • Built real-time streaming architectures using Apache Kafka, AWS Kinesis, Azure Event Hub and Service Bus,
  • supporting fraud detection, claims monitoring and operational telemetry.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10200946b
  • Position Id: 8954808
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Fremont, California

13d ago

Easy Apply

Contract, Third Party

Depends on Experience

Santa Clara, California

Yesterday

Easy Apply

Contract, Third Party

Depends on Experience

San Jose, California

6d ago

Easy Apply

Contract, Third Party

Depends on Experience

San Jose, California

Yesterday

Easy Apply

Full-time, Part-time, Third Party, Contract

Search all similar jobs