Job#: 3017540 Job Description: Overview:Our client is implementing Databricks from the ground up and seeking mid-to senior-level engineers who can guide best practices, platform adoption, and governance. This is a greenfield environment, ideal for consultants who want to shape architecture and standards from day one. You will collaborate with Palantir teams and help establish a modern data ecosystem that includes Unity Catalog and emerging AI capabilities.
What you'll do:- Lead Databricks platform build-out. Define and implement foundational structures for catalogs, schemas, and data assets; set up permissions and governance in Unity Catalog.
- Establish best practices. Advise on ingestion, modeling, and orchestration patterns for practical applications in a new Databricks environment.
- Enable AI features. Explore and prototype Databricks AI capabilities (Mosaic AI, AI/BI Genie, DBRX, foundation models) to inform future adoption.
- Collaborate cross-platform. Work with Palantir engineers and Snowflake teams to ensure seamless integration and governance alignment.
- Document and coach. Create playbooks, standards, and knowledge artifacts to accelerate internal adoption.
Required qualifications:- Databricks expertise: Hands-on experience with Databricks platform components (Workspaces, Clusters, Jobs, SQL Warehouses) and Unity Catalog governance.
- Data Engineering: Strong SQL/PySpark skills; experience designing ingestion and transformation pipelines; familiarity with CI/CD and orchestration tools.
- Governance: Practical knowledge of catalog structures, asset registration, and permission models; prior involvement in a Unity Catalog implementation is highly preferred.
- Adaptability: Comfort working in a greenfield environment with evolving requirements; ability to set direction amid uncertainty.
- Bachelor's degree in Data Science, Statistics, Mathematics, Business Analytics, or a related field, or equivalent professional experience.
Certifications- Databricks certifications (Lakehouse Fundamentals, Data Engineer Associate/Professional) are a strong plus; willingness to obtain certification post-hire is expected.
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico. Apex uses a virtual recruiter as part of the application process. Click for more details.
Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Apex team member can provide.
Never miss an opportunity! Create an alert based on the job you applied for.