Lead Databricks Engineer

Lead Databricks Engineer

BCforward is currently seeking a highly motivated Lead Databricks Engineer in Remote

Position Title: Lead Databricks Engineer

Location: Remote
Anticipated Start Date: 8/18/2025
Please note this is the target date and is subject to change. BCForward will send official notice ahead of a confirmed start date.

Expected Duration: 6+ months with possibilities for extension

Job Type: Contract: 40 hrs/week

Payrate - $60 to $65/hr on W2

Job Description:

We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our Databricks platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.

Key Responsibilities:

• Provide technical guidance to a team of data engineers in the development and maintenance of scalable data pipelines for the platform.


• Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.


• Collaborate with Data Platform Architects and other Data Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.


• Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.


• Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.


• Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.


• Implement secure and scalable data capture and ingestion workflows.


• Support data preparation, exploration, and visualization to facilitate data-driven decision-making.


• Design and implement robust data quality frameworks with Databricks ingestion pipelines, ensuring reliable, accurate, and trustworthy data for downstream analytics and decision making.


• Align and parameterize Databricks ingestion pipelines with CI/CD standards


• Design and implement conceptual, logical, and physical data models using best practices for Lakehouse architecture


• Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.

• Lead client facing workshops. Document Use Cases

• Define and implement standards and best practices for the Databricks platform

Qualifications:

• Bachelor's degree in Computer Science, a technical field, or a related business discipline. Equivalent experience, certifications, or training will be considered. Master degree preferred


• 5+ years of experience in designing and delivering secure cloud solutions.


• 3+ years of experience with Databricks


• 2+years of experience with AWS (preferred)


• 2+ years of experience with Agile Methodology


• Strong problem-solving, analytical, and communication skills.

Work Environment:

• Remote acceptable.


• Ability to travel to Philadelphia PA or Washington DC.


• Must work Eastern time zone


• This role does not provide visa sponsorship now, nor will it in the future.

Keywords:

Databricks, AWS, Agile

Benefits:

BCforward offers all eligible employees a comprehensive benefits package including, but not limited to major medical, HSA, dental, vision, employer-provided group life, voluntary life insurance, short-term disability, long-term disability, and 401k.

About BCforward:
Founded in 1998 on the idea that industry leaders needed professional service, and workforce management expert, to fuel the development and execution of core business and technology strategies, BCforward is a Black-owned firm providing unique solutions supporting value capture and digital product delivery needs for organizations around the world. Headquartered in Indianapolis, IN with an Offshore Development Center in Hyderabad, India, BCforward's 6,000 consultants support more than 225 clients globally.

BCforward champions the power of human potential to help companies transform, accelerate, and scale. Guided by our core values of People-Centric, Optimism, Excellence, Diversity, and Accountability, our professionals have helped our clients achieve their strategic goals for more than 25 years. Our strong culture and clear values have enabled

BCforward to become a market leader and best in class place to work.

BCforward is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against based on disability.
To learn more about how BCforward collects and uses personal information as part of the recruiting process, view our Privacy Notice and CCPA Addendum. As part of the recruitment process, we may ask for you to disclose and provide us with various categories of personal information, including identifiers, professional information, commercial information, education information, and other related information. BCforward will only use this information to complete the recruitment process.
This posting is not an offer of employment. All applicants applying for positions in the United States must be legally authorized to work in the United States. The submission of intentionally false or fraudulent information in response to this posting may render the applicant ineligible for the position. Any subsequent offer of employment will be considered employment at-will regardless of the anticipated assignment duration.

Interested candidates please send resume in Word format Please reference job code 241599 when responding to this ad.