Overview
Skills
Job Details
About Calfus
At Calfus, we are known for delivering cutting-edge AI agents and products that transform businesses in ways previously unimaginable. We empower companies to harness the full potential of AI, unlocking opportunities they never imagined possible before the AI era. Our software engineering teams are highly valued by customers, whether start-ups or established enterprises, because we consistently deliver solutions that drive revenue growth. Our ERP solution teams have successfully implemented cloud solutions and developed tools that seamlessly integrate with ERP systems, reducing manual work so teams can focus on high-impact tasks.
None of this would be possible without talent like you! Our global teams thrive on collaboration, and we re actively looking for skilled professionals to strengthen our in-house expertise and help us deliver exceptional AI, software engineering, and solutions using enterprise applications.
As one of the fastest-growing companies in our industry, we take pride in fostering a culture of innovation where new ideas are always welcomed without hesitation. We are driven and expect the same dedication from our team members. Our speed, agility, and dedication set us apart, and we perform best when surrounded by high-energy, driven individuals.
To continue our rapid growth and deliver an even greater impact, we invite you to apply for our open positions and become part of our journey!
Job Summary
We are seeking an experienced Sr. Data Architect with deep expertise in Databricks and other modern data platforms to design, optimize, and govern our data infrastructure. This role will be responsible for architecting scalable data solutions, integrating disparate data sources, and enabling advanced analytics and AI-driven insights. The ideal candidate will have extensive experience in cloud-based big data platforms, data modeling, and implementing ETL/ELT pipelines on Databricks and related technologies.
Key Responsibilities
- Architect & Implement Scalable Data Solutions: Design and implement high-performance data architectures leveraging Databricks, Apache Spark, and Delta Lake.
- Data Integration & Pipelines: Develop optimized ETL/ELT workflows using Databricks Workflows, Delta Live Tables, and integration with cloud storage solutions.
- Cloud Data Management: Design data lakehouse architectures in Azure/AWS/Google Cloud Platform using Databricks and similar platforms, ensuring high availability, security, and compliance.
- Performance Optimization: Optimize Spark jobs, query performance, and cluster configurations to ensure efficient data processing.
- Data Governance & Security: Implement data quality frameworks, access controls, and compliance measures using Unity Catalog, Delta Sharing, and equivalent tools.
- Collaboration & Leadership: Work closely with engineering teams, data scientists, and business analysts to enable data-driven decision-making.
- Machine Learning, Analytics & Agents Enablement: Support the development and operationalization of ML models, AI applications, and agent-based systems using Databricks, MLflow, Feature Store, and other ML/AI platforms such as SageMaker, Vertex AI, or Azure ML. Familiarity with agentic frameworks, AI agents, and orchestration tools (e.g., LangChain, AutoGen, CrewAI) is highly desirable.
- Technical Documentation: Maintain detailed architecture diagrams, process flows, and best practices documentation.
Qualifications & Skills
- 10+ years of experience in Data Architecture, with strong expertise in Databricks, Apache Spark, and other distributed data platforms.
- Proficiency in SQL, Python, Scala, and Cloud platforms (Azure, AWS, Google Cloud Platform).
- Deep understanding of Delta Lake, Medallion Architecture, and Data Engineering best practices.
- Experience in data governance, cataloging, and security (Unity Catalog, RBAC, IAM).
- Strong knowledge of distributed computing, data pipeline orchestration (Airflow, Azure Data Factory), and cloud storage (S3, ADLS, GCS).
- Experience integrating BI tools (Power BI, Tableau) with data platforms for analytics.
- Strong understanding of machine learning workflows, AI infrastructure, and emerging agentic technologies.
- Excellent problem-solving skills and ability to communicate complex technical concepts to non-technical stakeholders.
Preferred Qualifications
- Databricks certifications (Databricks Certified Data Engineer/Architect).
- Experience with data streaming technologies (Kafka, Spark Streaming).
- Familiarity with agentic frameworks, AI orchestration tools, and multi-agent systems.
- Hands-on experience with ML & AI platforms (e.g., SageMaker, Vertex AI, Azure ML).
Offered Benefits:
Calfus prioritizes the well-being and financial security of its employees by providing comprehensive health coverage, which includes medical (by Kaiser & Aetna), Dental & Vision (by Guardian) plans. This ensures that employees have access to essential healthcare services, addressing both preventive and ongoing medical needs.
Additionally, Calfus understands the importance of long-term financial planning for its employees. To support this, the company offers retirement savings plan (401k) where you can start saving as soon as you join!
Compensation:
Salary range for California residents only: Between $180,000.00 to $200,000.00 per year. Pay is based on several factors including but not limited to education, work experience, certifications, etc.
Calfus Inc. is an Equal Opportunity Employer.
That means we do not discriminate against any applicant for employment, or any employee because of age, color, sex, disability, national origin, race, religion, or veteran status. All employment is decided based on qualifications, merit and business need.