Search Jobs | Dice.com

1 results (1 new)

Group by company

Sr.Data Engineer

QUANTUM TECHNOLOGIES LLC

Dallas, Texas • Today

Easy Apply

Contract

$60 - $70

Job Details

Skills

SQl
python
Databricks
Apache
Spark

Summary

Position: Senior Data Engineer / Databricks Engineer
Location: Dallas, TX
Duration: Long Term
Client: SWA
Experience: 7+ Years

Role Overview

We are looking for a strong Senior Data Quality Engineer / Databricks Engineer who has hands-on experience in data quality, ETL/ELT testing, Databricks, AWS, Kafka, SQL, and Python.

The consultant will be responsible for validating end-to-end data pipelines and ensuring data is accurate, reliable, complete, and production-ready. This role involves working closely with Data Engineering, Platform, Analytics, and DevOps teams.

Key Responsibilities

Test and validate batch and streaming data pipelines for accuracy, completeness, consistency, and timeliness.
Develop data quality checks for nulls, duplicates, schema changes, and referential integrity.
Perform complex SQL-based data validations and verify business rules and transformations.
Test Databricks and Apache Spark pipelines using PySpark/Scala.
Validate ETL/ELT workflows using AWS Glue, Lambda, EMR, Step Functions, S3, Redshift, Athena, Kinesis, and DynamoDB.
Test Kafka streaming pipelines, including data integrity, ordering, offsets, partitions, and schema changes.
Validate Avro, JSON, and Protobuf data formats.
Test scenarios such as duplicate events, late-arriving data, consumer failures, backfills, and reprocessing.
Build and maintain Python-based automated data testing frameworks and reusable test utilities.
Integrate automated data quality testing into CI/CD pipelines.
Perform performance, regression, failover, and recovery testing for large-scale data pipelines.
Monitor pipeline metrics, logs, and alerts using CloudWatch, Prometheus, Grafana, or similar tools.
Troubleshoot data issues, perform root-cause analysis, and support production incidents.
Work with teams to establish and maintain data quality SLAs/SLOs.

Required Skills

7+ years of experience in QA, SDET, Data Quality Engineering, or similar roles.
Strong hands-on SQL experience for complex data validation.
Strong Python experience for automation and data testing.
Hands-on experience with Databricks, Apache Spark, and PySpark.
Strong experience testing ETL/ELT and data pipelines.
Hands-on experience with Kafka or other streaming technologies.
Strong knowledge of AWS data services such as S3, Glue, Redshift, Lambda, and Athena.
Experience working with large datasets and distributed systems.
Strong debugging and analytical skill

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91099737
Position Id: 9062577
Posted 3 hours ago

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Contact the job poster

Rithika Varma

Recruiter @ QUANTUM TECHNOLOGIES LLC

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Dallas, Texas

•

Today

Location: Dallas, TxRate $55w2Any Visa who can be on our w2 (EXCEPT OPT AND CPT)We have first round of interview throughout this week and it will be in Granite Park, Plano Texas Final round will be at Southwest Airlines HQ in Dallas. Data Engineer Quality EngineerWe are seeking a Data Engineer Quality Engineer to ensure the reliability, accuracy, performance, and scalability of our data platforms and pipelines. This role focuses on validating endtoend data ingestion, processing, streaming, and a

Easy Apply

Contract

$50 - $55

Data Quality Engineer

Dallas, Texas

•

Today

Benefits: W2 OPPORTUNITY Competitive salary Opportunity for advancement Job Title: Data Quality Engineer (Databricks, Kafka, AWS) Location: Dallas, TX (Hybrid - 3 days onsite) Job Type: Long-term Contract Work Authorization: Open - W2 opportunity Interview Process: In-person (Client interview- Mandatory) We are looking for a Data Quality Engineer to own validation across batch and streaming data pipelines. This role focuses on ensuring data correctness, reliability, and performance across plat

Full-time

USD 62.00 - 65.00 per hour

Data Quality Automation Engineer

Dallas, Texas

•

Today

Job Description Data Quality Automation Engineer Location: Hybrid About the Role We are seeking a Data Quality Automation Engineer to build and scale automated data quality solutions that ensure the accuracy, consistency, and reliability of enterprise data. In this hands-on role, you'll develop automation frameworks, integrate data quality validation into modern data pipelines, and partner with cross-functional teams to ensure trusted data powers analytics, reporting, and AI initiatives. You'l

Full-time

Software Engineering - Data, Lakehouse and AI Data Platform Engineer - Associate - Dallas

Dallas, Texas

•

Today

Job Description The Opportunity Join a team building the data foundations that support the firm's AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data use across the firm. At Goldman Sachs, engineering teams are positioned at the centre of the business, building scalable systems, solving complex technical problems and turning data into action. In data enginee

Full-time

Job Details

Skills

SQl
python
Databricks
Apache
Spark

Summary

Position: Senior Data Engineer / Databricks Engineer
Location: Dallas, TX
Duration: Long Term
Client: SWA
Experience: 7+ Years

Role Overview

We are looking for a strong Senior Data Quality Engineer / Databricks Engineer who has hands-on experience in data quality, ETL/ELT testing, Databricks, AWS, Kafka, SQL, and Python.

Key Responsibilities

Test and validate batch and streaming data pipelines for accuracy, completeness, consistency, and timeliness.
Develop data quality checks for nulls, duplicates, schema changes, and referential integrity.
Perform complex SQL-based data validations and verify business rules and transformations.
Test Databricks and Apache Spark pipelines using PySpark/Scala.
Validate ETL/ELT workflows using AWS Glue, Lambda, EMR, Step Functions, S3, Redshift, Athena, Kinesis, and DynamoDB.
Test Kafka streaming pipelines, including data integrity, ordering, offsets, partitions, and schema changes.
Validate Avro, JSON, and Protobuf data formats.
Test scenarios such as duplicate events, late-arriving data, consumer failures, backfills, and reprocessing.
Build and maintain Python-based automated data testing frameworks and reusable test utilities.
Integrate automated data quality testing into CI/CD pipelines.
Perform performance, regression, failover, and recovery testing for large-scale data pipelines.
Monitor pipeline metrics, logs, and alerts using CloudWatch, Prometheus, Grafana, or similar tools.
Troubleshoot data issues, perform root-cause analysis, and support production incidents.
Work with teams to establish and maintain data quality SLAs/SLOs.

Required Skills

7+ years of experience in QA, SDET, Data Quality Engineering, or similar roles.
Strong hands-on SQL experience for complex data validation.
Strong Python experience for automation and data testing.
Hands-on experience with Databricks, Apache Spark, and PySpark.
Strong experience testing ETL/ELT and data pipelines.
Hands-on experience with Kafka or other streaming technologies.
Strong knowledge of AWS data services such as S3, Glue, Redshift, Lambda, and Athena.
Experience working with large datasets and distributed systems.
Strong debugging and analytical skill

Dice Id: 91099737
Position Id: 9062577
Posted 3 hours ago

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Contact the job poster

Rithika Varma

Recruiter @ QUANTUM TECHNOLOGIES LLC

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Dallas, Texas

•

Today

Easy Apply

Contract

$50 - $55

Data Quality Engineer

Dallas, Texas

•

Today

Full-time

USD 62.00 - 65.00 per hour

Data Quality Automation Engineer

Dallas, Texas

•

Today

Full-time

Software Engineering - Data, Lakehouse and AI Data Platform Engineer - Associate - Dallas

Dallas, Texas

•

Today

Full-time

Sr.Data Engineer

Skills

Summary

Role Overview

Key Responsibilities

Required Skills

Dice Job Match Score™

Rithika Varma

Similar Jobs

Sr.Data Engineer

Job Details

Skills

Summary

Role Overview

Key Responsibilities

Required Skills

Dice Job Match Score™

Rithika Varma

Similar Jobs