Job Title: Forward Deployed Engineer (Databricks & Data Platforms)
FDE should be AI/ML oriented but with Resident Solution Architect background in Databricks
Role Overview
We are seeking an experienced Forward Deployed Engineer (FDE) to act as the primary technical bridge between our data platforms and client success. This is a high-velocity role for an engineer who thrives in ambiguity and can context-switch seamlessly between multiple concurrent client projects. Unlike traditional architecture roles, you will be embedded directly within client delivery teams to own the end-to-end implementation of Databricks-centric Lakehouse platforms. You will be responsible for translating complex requirements into production-ready systems, ensuring rapid delivery without compromising technical rigor.Key Responsibilities
● Rapid Delivery & Multi-Project Agility: Manage technical priorities across multiple client engagements simultaneously, pivoting between distinct architectural needs in a fast-paced, high-demand environment.
● CI/CD & Engineering Rigor: Architect and maintain automated CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins) for data engineering workflows, ensuring robust version control, automated testing, and seamless deployment of Databricks assets.
● Embedded Solution Delivery: Act as a core member of client delivery teams, translating business challenges into functional, high-impact data solutions.
● Platform Architecture: Architect, build, and launch end-to-end Databricks Lakehouse platforms using the Medallion Architecture (Bronze/Silver/Gold).
● Engineering Ownership: Own the full development lifecycle: from technical design and ETL/ELT pipeline construction (Databricks Workflows, SQL Warehouses, Spark) to deployment, monitoring, and production support.
● Data Governance & Security: Implement governed Lakehouse patterns (Unity Catalog, RBAC/ABAC, lineage, compliance) while balancing security with development agility.
● System Integration: Design distributed integration patterns across cloud-native services (AWS, Azure, Google Cloud Platform) and enterprise systems (CRM, ERP, Kafka/Kinesis streams).
● Operational Excellence: Lead architecture reviews, mentor client engineering teams, and drive cloud cost optimization across storage and compute.
Technical Qualifications
● Deep Databricks Expertise: Strong hands-on experience with Unity Catalog, Delta Live Tables (DLT), Photon engine, and Lakehouse Federation.
● CI/CD & DevOps: Demonstrated experience implementing CI/CD pipelines for data platforms. Proficiency with Infrastructure as Code (Terraform) and version control workflows.
● Data Engineering Rigor: Proficiency in Spark (PySpark & Scala), complex query tuning, performance optimization, and pipeline automation (Airflow, dbt).
● Full-Stack & Cloud Mindset: Hands-on experience with cloud infrastructure (AWS/Azure/Google Cloud Platform), containerization (Docker), and building/debugging data-connected applications (FastAPI/Flask/Node.js).
● Streaming & Real-time: Experience with real-time streaming technologies (Kafka, Kinesis, Pub/Sub, Auto Loader).
Interview & Placement Process
Our hiring process is designed for speed and precision, matching your unique skill set with
fast-moving, high-impact client projects. The typical timeline is one to few weeks, depending on current project allocations.
1. Initial Screening: A quick background and qualification screening with the team.
2. Client Introduction: A brief introductory phone call with the client to align on high-level goals.
3. Technical Deep-Dive: A one-round technical interview held by our Implementation Partner. This is where we analyze your depth of knowledge and technical versatility. Based on this assessment, we match your core strengths with the specific end-client requirements best suited to your profile.
● Note on Flexibility: If you are a strong candidate but not the right fit for the specific project discussed, we pivot to match you with other open end-client projects that utilize your skills.
4. Final Interview: A final discussion with the end client to confirm project fit. Could be multiple rounds based on project needs or allocations.
Ideal Candidate Profile
● The Adaptive Builder: You are comfortable jumping into unfamiliar codebases or project structures and immediately adding value. You don''t just "support" projects; you drive them.
● High-Pace Operator: You thrive in an environment where speed-to-market is critical. You balance the need for "quick wins" with long-term architectural stability.
● Client Partner: You possess the interpersonal skills to act as a technical advisor to stakeholders, managing expectations, translating technical trade-offs into business value, and maintaining trust across multiple concurrent workstreams.
● Ownership Mindset: You take complete pride in the quality of your code, the stability of your deployments, and the measurable success of your clients.
Never miss an opportunity! Create an alert based on the job you applied for.