About R Systems:
R Systems is a leading digital product engineering company that designs and develops chip-to-cloud software products, platforms, and digital experiences that empower its clients to achieve higher revenues and operational efficiency. Our product mindset and engineering capabilities in Cloud, Data, AI, and CX enable us to serve key players in the high-tech industry, including ISVs, SaaS, and Internet companies, as well as product companies in telecom, media, finance, manufacturing, and health verticals. We Are Great Place to Work Certified in 10 countries with a full-time workforce [India, USA, Canada, Poland, Romania, Moldova, Indonesia, Singapore, Malaysia & Thailand]! We are recognized as one of the Best Tech Brands 2024 by the Times Group and India's Top 500 Value Creators 2023 by Dun & Bradstreet.
Company Link:
Job Description
Key Responsibilities
- Unity Catalog Architecture: Design and deploy global Unity Catalog Metastores, defining the three-tier namespace strategy (Catalog > Schema > Table/Volume) to support domain-driven architectures.
- Access Control & Security: Implement fine-grained security models, including Attribute-Based Access Control (ABAC), row-level filtering, and column masking.
- Legacy Migration: Lead the transition from Hive Metastore to Unity Catalog using UCX (Unity Catalog Migration Toolkit) and automated upgrade paths.
- AI & Model Governance: Extend governance to AI assets, managing Mosaic AI models, functions, and GenAI agents within the Unity Catalog framework.
- Automated Lineage: Configure end-to-end lineage tracking for Delta Live Tables (DLT), notebooks, and workflows to support audit and impact analysis.
- Data Quality & Monitoring: Implement Databricks Lakehouse Monitoring to track data freshness, completeness, and statistical drift automatically.
Technical Capabilities & Experience
- Cataloging & Sharing: Deep expertise in Unity Catalog (Managed & External Tables), Volumes, and secure external data exchange via Delta Sharing.
- Data Engineering Foundations: Proficiency in Delta Lake architecture, Delta Live Tables (DLT), PySpark, Spark SQL, and performance optimization via Liquid Clustering.
- Identity & Access Management: Strong experience with Entra ID (Azure AD) ,SCIM Provisioning, and Managed Identities for secure resource access.
- Platform Operations: Mastery of Databricks Workflows and the use of System Tables for monitoring audit logs, billing, and lineage.
- Ecosystem Integration: Experience integrating Databricks with external catalogs (such as Collibra or Alation), BI tools (Power BI/Tableau), and transformation frameworks like dbt.
- Compliance Frameworks: Ability to operationalize Microsoft Purview or similar tools to monitor PII/PHI and ensure adherence to GDPR, HIPAA, or CCPA.
Required Qualifications
- Experience: 8+ years in Data Governance/Management, with at least 3 years of hands-on experience specifically in Databricks.
- Unity Catalog Mastery: Proven track record of at least two large-scale Unity Catalog implementations.
- Cloud Proficiency: Deep experience in Azure Databricks or AWS Databricks environments.
- Certifications: Required: Databricks Certified Data Engineer Professional. Preferred: Databricks Certified Machine Learning Professional or DAMA CDMP.
Why Join R Systems?- Frequent Internal Hackathons: Engage in dynamic competitions with exciting prizes to keep your skills sharp.
- Cultural Celebrations: Strengthen our familial bonds through shared celebrations, fostering a sense of community.
- Diverse Project Exposure: Work on a variety of projects across sectors like Healthcare, Banking, e-commerce, and Retail, collaborating with leading global brands.
- Centre of Excellence (COE): Benefit from technical guidance and upskilling opportunities provided by our team of technology experts, helping you navigate your career path.
- E-Learning Platform: Gain access to comprehensive e-learning platforms coupled with a robust mentorship program to enhance your skills.
- Open Door Policy: Embrace a culture of mutual support, respect, and open dialogue, promoting a collaborative work environment.
If you are passionate and excited about working in a fast-paced, innovative environment, we would love to hear from you!
#LI-AP2
R Systems is an equal opportunity employer that does not discriminate against any employee or job applicant because of race, color, religion, national origin, sex, physical or mental disability, age, or any other characteristic protected by law. We strive to build a team that reflects the diverse communities we serve, and we actively encourage applications from individuals of all backgrounds and experiences. Our commitment to equal opportunity extends to all aspects of employment, including recruitment, hiring, training, promotion, and benefits.
Employers have access to artificial intelligence language tools ( AI ) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Never miss an opportunity! Create an alert based on the job you applied for.
.jpg?format=webp)