Lead Data Engineer

Remote • Posted 1 hour ago • Updated 1 hour ago
Contract Corp To Corp
Contract W2
12 Years
Remote
$90/hr
Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

Summary

Job Description:
  • Strong Core Python & Engineering Foundations: Writing clean, generic, reusable Python code using Object-Oriented Programming (OOP), classes, and functions. They must understand code architecture (e.g., how values/references are passed).
  • Python Packaging & Deployment: Hands-on experience building Python packages, using wheel files, and publishing/serving them via PyPI.
  • Automated Testing: Routine experience writing Unit Tests and Integration Tests in an automated CI/CD setup.
  • CI/CD Tools: Strong familiarity with GitHub Actions for automating builds and deployments.
  • PySpark Core Knowledge: They don''t need to be a Databricks wizard, but they must know the engine under the hood. They need to understand:
  • Optimizing PySpark code when things run slow.
  • How partitioning and ordering work.
  • How to speed up heavy data transfers (e.g., tuning JDBC connection parameters to pull huge tables).
  • System Security & Access Controls: Understanding basic security concepts, access-based controls, and how to securely control data access across systems.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: saicon
  • Position Id: 26-74590
  • Posted 1 hour ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Remote

12d ago

Easy Apply

Full-time

$0 - $0

Remote

Today

Full-time

USD 117,600.00 - 161,700.00 per year

Remote or Minnesota

Today

Full-time

USD 188,251.00 - 230,084.00 per year

Remote or Atlanta, Georgia

Today

Full-time

USD 160,056.00 - 183,326.00 per year

Search all similar jobs