![]()
Job Title: Sr. Databricks Platform Engineer on AWS
Location: Remote, East Coast preferred but not mandatory
Duration: Contract - 9 months
Pay Range: $67/hr to $72/hr (W2)
Job ID: 372525
About BCforward
BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
Job Description
We are seeking a Databricks Platform Engineer on AWS to join our dynamic team. The ideal candidate will have strong experience in Databricks, PySpark, SQL, Delta Lake, and Unity Catalog and a proven ability to implement and operationalize metadata-driven ingestion frameworks, observability, governance, and CI/CD automation aligned to platform standards.
Responsibilities:
- Implement metadata-driven ingestion frameworks and standard ingestion patterns.
- Build batch, incremental, and CDC ingestion pipelines.
- Ensure pipelines follow standards for configuration, schema evolution, tagging, and error handling.
- Implement pipeline monitoring, metrics, and alerting for observability.
- Support operational validation, failure simulation, and recovery testing.
- Embed data quality rules and quarantine patterns within pipelines.
- Apply Unity Catalog tags for domain, owner, sensitivity, and freshness at ingestion time.
- Write governance metadata to governed schemas.
- Build CI/CD pipelines using GitHub Actions, including validation, promotion, and rollback.
- Ensure secret management via AWS Secrets Manager.
Required Skills & Qualifications:
- 5-8 years of data or platform engineering experience.
- 3+ years of hands-on Databricks experience on AWS.
- Strong PySpark and SQL proficiency.
- Experience with Delta Lake, Unity Catalog, and Git-based development.
Preferred Skills:
- Ingestion framework design and implementation.
- Monitoring and alerting implementation for data platforms.
- Production platform support and operations experience.
Why BCforward?
At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:
- Competitive compensation and benefits.
- Opportunities for growth with global clients.
- A supportive, inclusive culture that values innovation and people.
- Exposure to cutting-edge technologies and projects.
About Our Commitment
BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.
Interested? Apply Now!
If this sounds like the right opportunity for you, please apply with your most recent resume.
Never miss an opportunity! Create an alert based on the job you applied for.
