Tech Lead (Python + Databricks + Streamlit)

Hybrid in Woodbridge Township, NJ, US • Posted 5 hours ago • Updated 5 hours ago
Full Time
Hybrid
$60 - $70/hr
Company Branding Image
Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

  • Agile
  • Amazon Web Services
  • Apache Spark
  • Application Development
  • Cloud Computing
  • Collaboration
  • Conflict Resolution
  • Continuous Delivery
  • Continuous Integration
  • Cosmos-Db
  • Data Engineering
  • Data Governance
  • Data Processing
  • Data Quality
  • Database
  • Databricks
  • Design Documentation
  • Design Review
  • DevOps
  • Docker
  • ELT
  • Extract
  • Transform
  • Load
  • Git
  • MongoDB
  • MySQL
  • SQL
  • Python

Summary

Position Summary

We are looking for a Tech Lead with strong hands-on expertise in Python and Databricks, along with exposure to Streamlit (optional) for data-driven application development. The ideal candidate will lead technical design, architecture, and delivery of scalable data and application platforms while mentoring development teams and driving engineering best practices.

Key Responsibilities

  • Lead and mentor a team of developers and data engineers across the full software development lifecycle.
  • Design and develop scalable backend solutions, APIs, and data processing frameworks using Python.
  • Proficient in creating HLD, LLD, and detailed design documentation using visual artifacts.
  • Build and optimize enterprise-grade data pipelines using Databricks, PySpark, and Spark SQL.
  • Good understanding of Medallion Architecture, Data Quality rules, exception handling/correction processes, and reprocessing of correction DAGs.
  • Collaborate with Business analysts, technical and business stakeholders to translate requirements into technical solutions.
  • Drive code quality through design reviews, best practices, testing, and CI/CD implementation.
  • Ensure application reliability, scalability, security, and performance in cloud environments.
  • Support DevOps processes, deployment automation, monitoring, and production support.

Required Skills & Experience

  • 10 12+ years of experience in software development and data engineering.
  • Strong hands-on experience in Python
  • Extensive experience with Databricks, PySpark,
  • Good to have understanding of Streamlit or other modern UI frameworks for data applications Optional
  • Experience building scalable ETL/ELT pipelines and distributed systems.
  • Strong knowledge of Azure (preferred) or AWS cloud platforms.
  • Experience with Git, CI/CD pipelines, Docker, and containerized deployments.
  • Proficiency in SQL and database technologies (PostgreSQL, MySQL, MongoDB, CosmosDB, etc.).
  • Strong problem-solving, leadership, and stakeholder management skills.

Preferred Qualifications

  • Experience in Data Quality, Exception Handling, Metadata Management, Data Governance solutions.
  • Exposure to Agile/Scrum delivery models.
  • Experience leading teams in enterprise-scale data platform implementations.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91103449
  • Position Id: 9026406
  • Posted 5 hours ago

Company Info

About Decision Six Inc.

About Us

Decision Six Inc is leader in Decision Support Reporting, Business Process Improvements, Project Management, consulting and Technology Execution. we are committed to provide the clients with strategy and support that enables the Win-Win situations. We are led by the industry experts who have proven track record of delivering the best solutions and achieving the "Results in Every Environment"

Experience and expertise help us to turn opportunities and challenges into operational excellence for the organizations. Whether you are an individual seeking a new job, or an employer looking for help, Decision Six Inc is ready to meet your needs.

Decision Six Inc, logo embodies the key element behind the company's success - relationships. A unique balance exists between Decision Six Inc, their clients, and its associates. In all the years of growth and change, one thing has remained the same - dedication to unmatchable customer service while providing opportunities for the employees, temporary associates and clients by "Uniting Talent with Opportunity.

About_Company_OneAbout_Company_Two
Contact the job poster
ZS

Zahiruddin Siddique

Recruiter @ Decision Six Inc.
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

It looks like there aren't any Similar Jobs for this job yet.

Search all similar jobs