Databricks Tech Lead / Manager

Overview

Hybrid
$140,000 - $175,000
Full Time
No Travel Required

Skills

databricks
medallion architecture
sql
data pipelines
stakeholder engagement
project management

Job Details

Databricks Tech Lead / Manager
New York, NY Full Time
Hybrid (3 days onsite)
PRIMARY FUNCTION:
The Databricks Manager is responsible for architecting scalable, best-in-class Data Warehouse, Business Intelligence/Reporting solutions and processes, develop, and maintain our analytics platform. With a focus on driving data-driven decision-making, this role creates innovative reports, views, dashboards, scorecards, visualizations, and mobile analytics apps. The manager drives requirements gathering, Data Profiling, develops KPIs, metrics, and leads adoption of the platform. The manager works closely with the IT Management team and stakeholders across entire organization to develop data-informed reports, supporting successful business growth and operational efficiency.
RESPONSIBILITIES:

  • Design, develop and implement data solutions based on best industry practices.
  • Create data pipelines to facilitate the movement of data between multiple data sources and cloud databases to create a unified data view.
  • Transform and cleanse raw data into a format that is suitable for analysis and visualization.
  • Analyze business and functional requirements and translate those into database structures and technical designs.
  • Create and implement a Unified Data Framework and data model to bridge and to contextualize data sources across systems.
  • Define data validation rules and automation.
  • Ensure data quality across data warehouse and analytics platforms.
  • Develop visualizations, reports, dashboards, apps and KPI scorecards.
  • Deliver enhancements with a view towards effectively normalized databases, best practices, and integration of data stores.
  • Implement Software Development Lifecycle (SDLC) and other best practices, including the creation and maintenance of proper technical and business process documentation.
  • Partner with VP of IT in ROI analysis and business case studies for project approval.
  • Manage & execute projects, develop schedules, manage risks and issues, facilitate meetings, report status to IT Leadership and Business Stakeholders.
  • Perform Root Cause Analysis on major issues with a focus on finding ways to prevent repeated future problems.
  • Stay up to date with emerging technology trends and recommend relevant enhancements or integrations to improve operational effectiveness.

Work Experience:

  • The ideal candidate has 10 or more years' experience with software development, data warehouses & data lake, and demonstrable experience managing a team and external consultants.
  • Implementation experience with Databricks data warehouse & Tableau self-service analytics is essential.
  • Hands on experience with Data warehouse & BI tools (Tableau, Qlik Sense, Power BI, Databricks, Snowflake Tableau and Databricks preferred).
  • Well versed in SQL, Scripting, Database, ETL processes, Data Modeling, Data Warehouse methodologies, Data Management, Data Modeling and Performance Tuning.
  • SDLC implementation experience.
  • Knowledge of Salesforce CRM and Sage Intacct data model is preferred.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.