Databricks Lead/Architect

Remote • Posted 1 day ago • Updated 3 hours ago
Contract W2
Contract Independent
Remote
Depends on Experience
Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Job Details

Skills

  • data bricks
  • datalake
  • devops
  • AWS
  • AI/ML

Summary

Required Qualifications

Architecture & Design

Define and design end-to-end data lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native services.

Create reference architectures for batch, real-time, and streaming data pipelines.

Architect data ingestion, curation, storage, and governance frameworks.

Ensure the platform is scalable, secure, and optimized for performance and cost.

Establish standards for data lineage, metadata management, and compliance.

Work with enterprise architects to align Databricks solutions with overall cloud strategy (AWS).

Leadership & Delivery

Lead and mentor a team of data engineers in building robust data pipelines.

Collaborate with data scientists, BI teams, and business stakeholders to enable advanced analytics and AI/ML use cases.

Drive adoption of DevOps and CI/CD practices for data engineering.

Review designs and solutions to ensure adherence to architectural principles.

Implementation & Optimization

Build, optimize, and manage large-scale PySpark/SQL pipelines in Databricks.

Enable real-time data processing through Kafka, Kinesis, or Event Hubs.

Implement security best practices including RBAC, data masking, and encryption.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90939770
  • Position Id: 8933372
  • Posted 1 day ago

Company Info

About Infogen Software Inc.

Infogen Software Inc. is currently accepting resumes for a variety of positions. Please review the database of positions that we are seeking to fill and contact us for additional information about any specific opportunity.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

Today

Easy Apply

Contract, Third Party

90 - 95

Remote

Yesterday

Easy Apply

Contract

Depends on Experience

Remote

Yesterday

Easy Apply

Contract, Third Party

Depends on Experience

Remote

26d ago

Easy Apply

Contract, Third Party

Depends on Experience

Search all similar jobs