Lead Data Quality Engineer

Hybrid in Chicago, IL, US • Posted 1 day ago • Updated 1 day ago
Contract W2
12 Months
No Travel Required
Hybrid
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

  • Databricks
  • pytest
  • API testing
  • python
  • sql

Summary

If you are interested in below direct client position, please send your resume.

Job Title: Sr. Data Quality Engineer (Databricks/ Spark/ Delta Lake)

Location: Chicago, IL (onsite)

 

Job Description

Testing in Databricks

Pytest - Framework (Currently using)

Automated test

Test Data from Source system to landing zone

currently No one internally

API Testing

Data testing + Pytest + Data Transforming (Then fine with no Databricks)

Python or Pytest********

Databricks + Python + Sql is fine without Pytest

Required Qualifications:

  • 5+ years of experience in data engineering, data quality engineering, or related roles
  • Strong hands-on experience with Databricks, Spark (PySpark), and Delta Lake
  • Proven experience implementing data quality frameworks and controls in modern data platforms
  • Advanced SQL and data profiling/validation skills
  • Experience working with large-scale datasets in cloud environments (AWS or Azure)
  • Experience integrating data quality into ELT/ETL pipelines and orchestration tools
  • Strong understanding of data governance and data lifecycle management

 

Preferred Qualifications:

  • Experience in financial services or regulated environments
  • Familiarity with data governance tools (e.g., Collibra)
  • Experience with data observability or quality tooling (e.g., Monte Carlo, Great Expectations, Deequ, or similar)
  • Experience with real-time data quality validation (streaming pipelines)
  • Knowledge of regulatory reporting and data controls frameworks
  • Cloud or Databricks certifications

 

Technical Skills:

  • Databricks (Lakehouse, Unity Catalog, workflows)
  • Spark / PySpark
  • SQL (advanced)
  • Delta Lake
  • Data quality frameworks (rule engines, validation patterns)
  • Data observability and monitoring
  • Cloud platforms (AWS or Azure)
  • Orchestration tools (Airflow, Control-M)
  • APIs and data integration
  • CI/CD and DevOps
  • Data modeling and lineage concepts
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10334594
  • Position Id: 8990292
  • Posted 1 day ago

Company Info

About Javen Technologies, Inc

Javen Technologies is a global information technology company providing consulting, and outsourcing services. Our global delivery model, innovative approach, and industry knowledge allow us to provide cost-effective services that enable our clients to enhance business performance through technology. Javen Technologies is firmly committed to keeping our client success as priority number one. The key to our successful track record is our dedication to information technology services and the strong partnerships we’ve built with our clients. We aim to deliver excellence through our people, knowledge, and methodologies.

We specialize in Web Technologies, IoT, Cloud, MOBILE, UI/UX, ML/AI, ERP, CRM, Data Warehousing, BIG Data, and System Integration.

Javen Technologies has the expertise and capacity to deliver top-quality technology solutions globally, and a proven track record of helping our clients transform their businesses giving them a competitive edge in today’s ever-changing marketplace.

About_Company_One
Contact the job poster
Vasanth Dolai

Vasanth Dolai

Recruiter @ Javen Technologies, Inc
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Cincinnati, Ohio

Yesterday

Easy Apply

Contract

Depends on Experience

Hybrid in Fort Mill, South Carolina

Yesterday

Easy Apply

Contract

Depends on Experience

Hybrid in Fort Mill, South Carolina

Yesterday

Easy Apply

Contract

Depends on Experience

Hybrid in Fort Mill, South Carolina

Yesterday

Easy Apply

Contract

Depends on Experience

Search all similar jobs