Data architect

Palm Beach, FL, US • Posted 8 hours ago • Updated 4 hours ago
Contract Independent
Contract Corp To Corp
Contract W2
On-site
$40 - $60/hr
Fitment

Dice Job Match Score™

🫥 Flibbertigibetting...

Job Details

Skills

  • Auditing
  • Broadcasting
  • CheckPoint
  • Cloud Computing
  • Continuous Delivery
  • Continuous Integration
  • Dashboard
  • IoT
  • KPI
  • Maximo
  • Microsoft Power BI
  • Modeling
  • Orchestration
  • Performance Tuning
  • PySpark
  • SCADA
  • SQL
  • Semantics
  • Specification Gathering
  • Streaming
  • Time Series
  • Unified Communications
  • Workflow

Summary

Technical Architect Data Platforms & Cloud Pipelines Hands-on Technical Architect specializing in OT data (SCADA, historians, IoT, Maximo), delivering scalable streaming, batch ingestion. Deep expertise in PySpark performance tuning, time-series modeling, and OT semantics (tags, events, assets, work orders).

Delivery Engineering for - Standards: repos structure, CI/CD for notebooks/jobs/DLT Data contracts, unit tests for transforms, backfill/runbooks/rollback. Reference implementations: golden pipelines (templates), KPI marts, and example notebooks.

Define bronze/silver/gold zones on Delta Lake with open table formats and versioned schemas. Publish semantic/consumption layers for Power BI/Fabric

Build incremental pipelines with streaming MERGE, watermarking, exactly-once upserts, and dedup (tag, ts, src_seq). Implement Auto Loader for historian/IoT drop zones; DLT expectations for DQ; Workflows for orchestration & SLAs. Implement observability: DQ metrics, lineage, run health, cost dashboards (jobs, clusters, SQL). Gold KPIs: availability, reliability, MTBF/MTTR, downtime attribution, with reproducible SQL specs.

Row/column-level security, attribute-based policies; data classification, masking for sensitive/plant data. Managed access via UC volumes, external locations, credential passthrough; audit lineage and permissions. Data lifecycle: retention tiers (hot/warm/cold), VACUUM policies, OPTIMIZE and ZORDER maintenance. Optimize joins via broadcast hints, bucketing, checkpoint pruning, and state store tuning.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90769335A
  • Position Id: 8902590
  • Posted 8 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Palm Beach, Florida

Today

Easy Apply

Contract

Depends on Experience

No location provided

Today

Full-time

USD 85,100.00 - 169,800.00 per year

Remote

Today

Easy Apply

Contract

Depends on Experience

No location provided

Today

Full-time

USD 106,400.00 - 203,600.00 per year

Search all similar jobs