Databricks Engineer with Test Data Management
Neural Strategic Solutions, Inc.
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Test Data Management (data masking
- de-identification
- synthetic data generation)
Summary
Old National Bank
Databricks Engineer with Test Data Management - REMOTE
Chicago - remote - They want candidate local to Chicago but the role is remote !
6+ month
Must-Have Experience
- 8+ years in Data Engineering, Data Architecture, or Data Platform roles
- 3+ years hands-on Databricks (Lakehouse, Delta Lake, Unity Catalog, PySpark)
- Medallion Architecture implementation (Bronze/Silver/Gold)
- Unity Catalog / data governance rollout experience
- Enterprise data governance — Role based access control, metadata management, data classification, lineage, access control
- Scalable ingestion, transformation, and provisioning pipelines
- Azure (ADF, DevOps, Synapse) and/or AWS (S3, Lambda, Glue, Redshift, MWAA)
- Python and PySpark development
Highly Desired
- Test Data Management (data masking, de-identification, synthetic data generation)
- AI-powered data discovery and classification
- Generative AI / Databricks Mosaic AI
- Data observability and monitoring frameworks
- Cross-team framework rollout and enablement
Nice to Have
- CI/CD and IaC (Terraform, Azure DevOps, GitHub Actions)
- Regulatory compliance (PII, GDPR, CCPA, HIPAA)
Key Responsibilities:
- Roll out TDM framework across projects on Databricks
- Establish governance controls for sensitive data in lower environments
- Build scalable pipelines for test data generation, masking, and refresh
- Implement metadata management and lineage capabilities
- Design synthetic data strategies for non-production environments
- Enable self-service access to compliant test datasets
- Develop reusable, automated data provisioning and lifecycle frameworks
- Partner with QA, application teams, data governance, and security
- Dice Id: 91166296
- Position Id: 9140400
- Posted 3 hours ago
Company Info
About Neural Strategic Solutions, Inc.
Neural Strategic Solutions Inc. is a professional staffing and solutions firm providing flexible and permanent staffing solutions in various IT Domains. Within our staffing offering, we provide temporary, temporary-to-hire, direct placement services for individual as well as full team placements.
Neuralss Inc. has embarked on a journey to deliver exceptional IT consultancy services. Our team is dedicated to providing innovative solutions and exceeding client expectations. We take pride in our unique approach and commitment to delivering quality results that set us apart from the competition.