Job Title: Senior Data Test Engineer (Databricks & Azure)
Location: Philadelphia, PA
Duration: Long Term
Job Note:
Need an experienced Databricks Testing SME for a Healthcare client in Philadelphia, PA. Strong experience with Azure Databricks, SQL, ETL/Data Warehouse Testing, Azure DevOps, and CI/CD pipelines is required. Healthcare domain experience is highly preferred.
Job Summary
We are seeking an experienced Databricks Testing SME to support a leading Healthcare client in Philadelphia, PA. The ideal candidate will have strong expertise in Databricks testing, Azure cloud technologies, SQL, and CI/CD pipelines. The candidate will be responsible for validating enterprise data platforms, ensuring data quality, and supporting end-to-end testing of cloud-based data solutions.
Required Skills
- 8+ years of experience in ETL/Data Warehouse Testing
- 3+ years of hands-on Databricks testing experience
- Strong SQL skills for complex data validation
- Experience with Azure Databricks
- Experience with Azure Data Factory (ADF)
- Knowledge of Spark and Delta Lake
- Experience with Azure DevOps and CI/CD pipelines
- Experience with Git version control
- Strong understanding of Agile/Scrum methodology
- Excellent communication skills
Responsibilities
- Validate Azure Databricks data pipelines and transformations.
- Perform ETL and Data Warehouse testing.
- Create SQL queries for source-to-target validation.
- Execute functional, integration, regression, and UAT testing.
- Automate testing within Azure DevOps CI/CD pipelines.
- Identify and resolve data quality issues.
- Collaborate with Data Engineers, Architects, and Business teams.
Preferred
- Healthcare domain experience
- Python/PySpark
- Synapse Analytics
- Test automation experience
Never miss an opportunity! Create an alert based on the job you applied for.