Microsoft Databricks Engineer (& USC)

We’re looking for a Microsoft Databricks Engineer to design, build, and support scalable data pipelines and lakehouse solutions using Databricks on cloud platforms (primarily Azure). You’ll partner with analysts and stakeholders to translate requirements into reliable datasets and data products, contribute to platform health and performance, and help ensure strong data quality, integrity, and security across the data lifecycle—aligned to patterns such as Medallion (Bronze/Silver/Gold) and emerging Data Mesh concepts.

Required Skills

-Hands-on experience with Databricks and core data engineering tools (SQL, Python, Spark; Hadoop familiarity acceptable)

-Experience designing and building data pipelines and ETL/ELT processes

-Experience with cloud data platforms (e.g., Azure; Google Cloud Platform exposure helpful)

-Working knowledge of data modeling, data architecture, and database design (relational and NoSQL)

-Knowledge of data governance, data quality, and security best practices

-Experience with workflow orchestration tools (e.g., Airflow, Luigi)

-Familiarity with organizing data using Medallion Pattern and understanding centralization vs. decentralization approaches (including Data Mesh principles)

-Strong problem-solving, communication, and documentation skills

Nice to Have Skills

-Experience with cloud data warehousing solutions (e.g., Snowflake, Redshift, BigQuery)

-Exposure to BI and visualization tools (e.g., Power BI, Tableau)

-Familiarity with performance tuning, optimization, and troubleshooting of data systems

-Experience with machine learning platforms and data science workflows

-Familiarity with real-time / streaming technologies (e.g., Kafka, Flink)

-Professional experience with Go (Golang)

-Experience in regulated industries (e.g., finance, healthcare)