Senior Data Engineer (Starburst SME)

Charlotte, NC, US • Posted 8 hours ago • Updated 2 hours ago
Contract W2
On-site
USD54 - USD65/hr
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • Senior Data Engineer (Starburst SME)

Summary

job summary:

Starburst


Design and implement Starburst SQL queries, catalogs, schemas, and connectors.


Develop data pipelines and federated query solutions across diverse sources (S3, RDBMS etc.).


Tune and optimize Starburst clusters, catalogs, and worker configurations for performance.





location: Charlotte, North Carolina

job type: Contract

salary: $54.00 - 64.62 per hour

work hours: 9am to 5pm

education: Bachelors



responsibilities:

Starburst


  • Design and implement Starburst SQL queries , catalogs, schemas, and connectors.
  • Develop data pipelines and federated query solutions across diverse sources (S3, RDBMS etc.).
  • Tune and optimize Starburst clusters, catalogs, and worker configurations for performance.
Airflow Development & Orchestration


  • Design, develop, test, and deploy Airflow DAGs for complex data workflows.
  • Implement best practices for Airflow, including task retries, SLAs, scheduling, and monitoring.
  • Build custom Airflow operators, hooks, and plugins using Python.
Data Pipeline Engineering


  • Build and maintain data ingestion and transformation pipelines using SQL, Python, and/or Airflow.
  • Implement Starburst-integrated ETL/ELT workflows with distributed compute.
  • Ensure pipelines are scalable, fault-tolerant, and performance-optimized.
  • Implement data quality checks, validation, and lineage tracking.
Cloud & Infrastructure Integration


  • Work with cloud platforms to integrate Airflow with services such as Netapp S3
  • Deploy and manage Airflow environments like Kubernetes.
Data Governance & Security


  • Implement security policies, row/column-level security, and data masking.
  • Ensure compliance with enterprise governance frameworks.
  • Document data lineage, metadata, and catalog configurations
Preferred: ThoughtSpot Development & Configuration (Or another BI tool)


  • Develop and manage ThoughtSpot worksheets, Liveboards, Answers, and SpotIQ insights .
  • Build intuitive, user-friendly search experiences enabling self-service analytics.
  • Configure data models, relationships, and joins to ensure high-quality analytical results.
  • Implement row-level and column-level security policies.


Required Qualifications


  • 3+ years of hand on Experience with Starburst Enterprise Platform .
  • Familiarity with Kubernetes deployments.
  • Knowledge of cost governance & workload isolation in distributed environments.
  • 3+ years of experience working with Apache Airflow (core, providers, DAG authoring).
  • Strong proficiency in Python .
Solid understanding of data modeling concepts (star schema, relational modeling).


Experience integrating BI tools with ELT/ETL pipelines.


  • Hands-on experience with cloud-based Airflow deployments
  • Experience with SQL and relational databases
  • Experience with Git and CI/CD frameworks
Preferred Qualifications


  • Experience with BI tools (Tableau, Power BI, Oracle OAS/OAC) using Starburst as a source.




qualifications:

Starburst


Design and implement Starburst SQL queries, catalogs, schemas, and connectors.


Develop data pipelines and federated query solutions across diverse sources (S3, RDBMS etc.).


Tune and optimize Starburst clusters, catalogs, and worker configurations for performance.


Airflow Development & Orchestration


Design, develop, test, and deploy Airflow DAGs for complex data workflows.


Implement best practices for Airflow, including task retries, SLAs, scheduling, and monitoring.


Build custom Airflow operators, hooks, and plugins using Python.


Data Pipeline Engineering


Build and maintain data ingestion and transformation pipelines using SQL, Python, and/or Airflow.


Implement Starburst-integrated ETL/ELT workflows with distributed compute.


Ensure pipelines are scalable, fault-tolerant, and performance-optimized.


Implement data quality checks, validation, and lineage tracking.


Cloud & Infrastructure Integration


Work with cloud platforms to integrate Airflow with services such as Netapp S3


Deploy and manage Airflow environments like Kubernetes.


Data Governance & Security


Implement security policies, row/column-level security, and data masking.


Ensure compliance with enterprise governance frameworks.


Document data lineage, metadata, and catalog configurations


Preferred: ThoughtSpot Development & Configuration (Or another BI tool)


Develop and manage ThoughtSpot worksheets, Liveboards, Answers, and SpotIQ insights.


Build intuitive, user-friendly search experiences enabling self-service analytics.


Configure data models, relationships, and joins to ensure high-quality analytical results.


Implement row-level and column-level security policies.


Required Qualifications


3+ years of hand on Experience with Starburst Enterprise Platform.


Familiarity with Kubernetes deployments.


Knowledge of cost governance & workload isolation in distributed environments.


3+ years of experience working with Apache Airflow (core, providers, DAG authoring).


Strong proficiency in Python.


Solid understanding of data modeling concepts (star schema, relational modeling).


Experience integrating BI tools with ELT/ETL pipelines.


Hands-on experience with cloud-based Airflow deployments


Experience with SQL and relational databases


Experience with Git and CI/CD frameworks


Preferred Qualifications


Experience with BI tools (Tableau, Power BI, Oracle OAS/OAC) using Starburst as a source.




Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: cxsapwma1
  • Position Id: 1331520
  • Posted 8 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Charlotte, North Carolina

Today

Easy Apply

Contract

USD0 - USD0

Hybrid in Charlotte, North Carolina

8d ago

Easy Apply

Contract

$60 - $65

Charlotte, North Carolina

Today

Easy Apply

Contract

$69.5 - $76.16

Charlotte, North Carolina

Today

Contract

USD 69.00 - 74.00 per hour

Search all similar jobs