Overview
Skills
Job Details
1. Data Architecture Design and Implementation:
2. Design and implement cloud-based data architectures leveraging Databricks, AWS, Azure, or Google Cloud Platform.
3. Architect end-to-end data pipelines that integrate with Databricks and other cloud services.
4. Ensure that the data architecture supports both batch and real-time data processing and analytics.
5. Leverage Databricks Delta Lake for data storage, management, and processing.
6. Data Integration:
7. Integrate data from various sources, including operational databases, data lakes, and third-party APIs.
8. Work with teams to ensure seamless ETL/ELT processes within the Databricks environment
9. Collaborate with data engineers to build data ingestion pipelines and automate data workflows.