Overview
On Site
$65 - $67.57 hr
Contract - W2
Contract - Independent
Skills
DATABRICKS
DBX
SPARK
PYSPARK
PYTHON
AZURE
CI/CD
Job Details
Payrate: $65.00 - $67.57/hr.
Summary:
We are seeking a Senior QA Engineer / SDET with strong experience in data lake validation, Databricks automation, and reporting tool testing. The ideal candidate will be responsible for building and executing test strategies that ensure data quality, reliability, and compliance across complex data pipelines at enterprise scale.
This role will focus heavily on data validation, functional testing of Databricks transformations, and automation of data quality checks. The candidate must have prior hands-on experience with data lake validations, Spark/Python scripting, and Azure cloud tools.
Responsibilities:
Requirements:
Pay Transparency: The typical base pay for this role across the U.S. is: $65.00 - $67.57/hr. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience and the benefits package you select. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, 10 paid days off, 401(k) plan participation, commuter benefits and life and disability insurance.
Consent to Communication and Use of AI Technology: By submitting your application for this position and providing your email address(es) and/or phone number(s), you consent to receive text (SMS), email, and/or voice communication whether automated (including auto telephone dialing systems or automatic text messaging systems), pre-recorded, AI-assisted, or individually initiated from Aditi Consulting, our agents, representatives, or affiliates at the phone number and/or email address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary.
You represent and warrant that the email address(es) and/or telephone number(s) you provided to us belong to you and that you are permitted to receive calls, text (SMS) messages, and/or emails at these contacts. You also acknowledge and agree to Aditi Consulting LLC s use of AI technology during the sourcing process, including calls from an AI Voice Recruiter. AI is used solely to gather data and does not replace human-based decision-making in employment decisions. Calls may be recorded.
Consent is not a condition of purchasing any property, goods, or services. You may revoke your consent at any time by replying STOP to messages or by contacting .
For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our
#AditiConsulting
#25-22834
Summary:
We are seeking a Senior QA Engineer / SDET with strong experience in data lake validation, Databricks automation, and reporting tool testing. The ideal candidate will be responsible for building and executing test strategies that ensure data quality, reliability, and compliance across complex data pipelines at enterprise scale.
This role will focus heavily on data validation, functional testing of Databricks transformations, and automation of data quality checks. The candidate must have prior hands-on experience with data lake validations, Spark/Python scripting, and Azure cloud tools.
Responsibilities:
- Own the test strategy, implementation, and automation for batch and streaming data pipelines on Databricks, Azure Data Explorer (ADX), and cloud data lakes.
- Build automated tests and quality gates for data ingestion, transformation, and output validation (ADX/Delta/Parquet/SQL).
- Integrate test automation into CI/CD pipelines.
- Partner with data engineers, platform, and analytics teams to ensure correctness, reliability, and compliance.
- Design and automate functional validation of Databricks transformations (modern equivalent of ETL validation).
- Create and execute use cases for payments and transactions (CC authorization, authorization, purchases, modifications, domain-specific data).
- Perform validation for data logs, reporting outputs, and Power BI dashboards.
- Support legacy test scripts, when necessary, while driving modernization.
Requirements:
- Proven hands-on experience with Databricks test automation, Spark, Python, and Azure.
- Strong background in data validation for data lakes and transformations.
- Experience with automation frameworks, functional testing, and CI/CD integration.
- Knowledge of Kusto (ADX), SQL, and Parquet/Delta data formats.
- Some UI automation experience is a plus (ability to learn quickly).
- Familiarity with financial transaction/payment validations strongly preferred.
- Excellent communication skills: ability to operate at a senior level, explain strategy, and demonstrate prior impact.
- Senior level QA/SDET with a proven track record of delivering automation in Databricks and Azure ecosystems
- Quick to learn functional and technical aspects of new systems
- Strong communicator
Pay Transparency: The typical base pay for this role across the U.S. is: $65.00 - $67.57/hr. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience and the benefits package you select. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, 10 paid days off, 401(k) plan participation, commuter benefits and life and disability insurance.
Consent to Communication and Use of AI Technology: By submitting your application for this position and providing your email address(es) and/or phone number(s), you consent to receive text (SMS), email, and/or voice communication whether automated (including auto telephone dialing systems or automatic text messaging systems), pre-recorded, AI-assisted, or individually initiated from Aditi Consulting, our agents, representatives, or affiliates at the phone number and/or email address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary.
You represent and warrant that the email address(es) and/or telephone number(s) you provided to us belong to you and that you are permitted to receive calls, text (SMS) messages, and/or emails at these contacts. You also acknowledge and agree to Aditi Consulting LLC s use of AI technology during the sourcing process, including calls from an AI Voice Recruiter. AI is used solely to gather data and does not replace human-based decision-making in employment decisions. Calls may be recorded.
Consent is not a condition of purchasing any property, goods, or services. You may revoke your consent at any time by replying STOP to messages or by contacting .
For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our
#AditiConsulting
#25-22834
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.