Remote
•
20d ago
Key ResponsibilitiesDesign, build, and orchestrate scalabledata pipelinesusing Azure-native services.Develop and optimizebatch and near real-time data processing solutionsusing Spark and Databricks.Implement and manageenterprise-grade Lakehouse architectures(Medallion architecture).Performdata processing, validation, and automationusing Python (PySpark, Pandas, NumPy).Optimize performance of large-scale data systems, includingSpark tuning and query optimization.Work withCDC (Change Data Capture)
Easy Apply
Contract
45 - 50




