Data Engineer (Strong DBT and Python :: W2 ONLY)

Databricks + dbt expert

Strong in Python-based ingestion + pipeline development

Proven experience building medallion architecture (Bronze/Silver/Gold)

Comfortable in greenfield / early-stage environments

Able to lead, build, and influence business users

Job Responsibilities-

• Collaborate with cross-functional teams to understand and define business intelligence needs and translate them into data modeling solutions
• Supports in the development and maintenance of data pipelines, data schema design, and dimensional data modelling for all system data sources, API integrations, and bespoke data ingestion files from external sources. Includes Batch and real-time pipelines.
• Create data models that will support comprehensive data insights, business intelligence tools, and other data science initiatives
• Develop monitoring controls and alerts for data processing interruptions
• Create data models and ETL procedures with traceability, data lineage and source control
• Design and implement data integration and data quality framework
• Implement data monitoring best practices with trigger based alerts for data processing KPIs and anomalies
• Investigate and remediate data problems, performing and documenting thorough and complete root cause analyses. Make recommendation for mitigation and prevention of future issues.
• Responsible for building and maintaining a robust and up to date documentation library
• Continually seek to optimize performance through database indexing, query optimization, stored procedures, etc.