Job Summary: We are seeking a Starburst Resource to support our ongoing QA/QC data initiative. This role will focus on configuring, optimizing, and maintaining Starburst-based federated
Job Description:
Configure and administer Starburst clusters for federated querying across AWS Redshift and Snowflake. Set up and manage Starburst connectors for Redshift and Snowflake, ensuring secure and performant connectivity between both platforms.
Design and optimize SQL queries to support QA/QC data validation, cross-platform reconciliation, and data comparison workflows.
Collaborate with QA/QC and data governance teams to define validation rules, reconciliation logic, and exception reporting across Redshift and Snowflake datasets.
Monitor query performance across federated sources, troubleshoot connector/cluster issues, and tune Starburst for optimal throughput.
Manage access control, security configuration, and catalog/schema setup for both Redshift and Snowflake connectors within Starburst.
Document architecture, connector configurations, and best practices for federated querying across the two platforms.
Partner with data engineering and platform teams to ensure the Starburst deployment aligns with broader enterprise data architecture standards.
Required Skills & Experience:
3+ years of hands-on Starburst experience.
Direct experience configuring Starburst connectors for both AWS Redshift and Snowflake.
Strong SQL skills, with experience in federated/distributed query environments.
Strong AWS skills, including Redshift, IAM, and networking/VPC configuration for connector setup.
Familiarity with data quality, reconciliation, or QA/QC frameworks in an enterprise data environment.
Understanding of connector configuration, catalog management, and cluster performance tuning in Starburst.
Ability to collaborate with cross-functional data governance and QA teams.
Preferred Qualifications:
Experience in banking/financial services data environments.
Familiarity with data governance and metadata management tools.
Starburst certification or equivalent hands-on project experience with multi-source federation.
Karthikeyan Chinnasamy | Asst manager - Training and Delivery | TechDigital Corporation | Phone: | Email & Hangout: | |
