Senior Databricks Engineer

Senior Databricks Engineer - Contract - Tampa, FL - $60.00 - $70.00/hr

The final salary or hourly wage, as applicable, paid to each candidate/applicant for this position is ultimately dependent on a variety of factors, including, but not limited to, the candidate's/applicant's qualifications, skills, and level of experience as well as the geographical location of the position.

Applicants must be legally authorized to work in the United States. Sponsorship not available.

Our client is seeking a Senior Databricks Engineer in Tampa, FL.

Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines using Databricks (Py Spark, Scala, or SQL).
Architect and optimize Delta Lake implementations to support reliable and performant data lakes.
Implement and enforce data quality, governance, and observability best practices within Databricks.
Collaborate with data scientists, analysts, and stakeholders to understand data needs and translate requirements into robust engineering solutions.
Lead the design and implementation of data solutions, including end-to-end technical strategies for production.
Monitor and optimize data workflows for cost efficiency and performance, especially in cloud environments (Azure, AWS, or Google Cloud Platform).
Lead migration efforts from legacy data systems to Databricks and modern cloud-native architectures.
Mentor junior engineers and establish best practices for code quality, version control, and CI/CD processes.
Participate in data modeling and help enforce medallion architecture standards (bronze, silver, gold layers).

Skills & Requirements

Bachelor's or Master's degree in Computer Science, Engineering, or related field.
5+ years of experience in data engineering, with at least 2+ years hands-on with Databricks.
Expert-level proficiency in Spark (Py Spark and/or Scala) and SQL.
Deep experience with Delta Lake, data lake house architectures, and advanced performance optimization techniques (e.g., adaptive query execution, optimized writes, Z-ordering, caching strategies).
Experience with data lineage and data catalog tools (e.g., Unity Catalog, Azure Purview).
Proficiency in building and managing streaming data pipelines using Structured Streaming in Databricks.
Strong knowledge of data encryption, masking, and data privacy best practices.
Strong experience with orchestration tools (e.g., Airflow, Azure Data Factory, Databricks Workflows).
Proficiency with monitoring and logging solutions
Proven experience in technical design, solution architecture, and implementation strategy.
Strong knowledge of Azure Data Lake, Azure Data Factory, and Azure Synapse (or equivalents in AWS/Google Cloud Platform).
Proficiency in CI/CD for data pipelines (e.g., GitHub Actions, Azure DevOps, Jenkins).
Solid understanding of data security, identity management, and access control in the cloud.
Familiarity with Infrastructure-as-Code (Ia C) tools (e.g., Terraform, ARM templates, CloudFormation).
Other Desired Skills/Certifications:
Experience with ML and AI prompt engineering
Experience implementing medallion architecture in production environments.
Databricks certifications (e.g., Databricks Certified Data Engineer Professional).
Familiarity with ML flow, Unity Catalog, and Databricks Delta Live Tables (DLT).
Excellent problem-solving and troubleshooting skills.
Strong communication skills, both written and verbal.
Ability to work independently and lead cross-functional initiatives.
Passion for automation, reusability, and performance optimization.

Benefits/Other Compensation

This position is a contract/temporary role where Hays offers you the opportunity to enroll in full medical benefits, dental benefits, vision benefits, 401K and Life Insurance ($20,000 benefit).

Why Hays?

You will be working with a professional recruiter who has intimate knowledge of the industry and market trends. Your Hays recruiter will lead you through a thorough screening process in order to understand your skills, experience, needs, and drivers. You will also get support on resume writing, interview tips, and career planning, so when there's a position you really want, you're fully prepared to get it.

Nervous about an upcoming interview? Unsure how to write a new resume?

Visit the Hays Career Advice section to learn top tips to help you stand out from the crowd when job hunting.

Hays is committed to building a thriving culture of diversity that embraces people with different backgrounds, perspectives, and experiences. We believe that the more inclusive we are, the better we serve our candidates, clients, and employees. We are an equal employment opportunity employer, and we comply with all applicable laws prohibiting discrimination based on race, color, creed, sex (including pregnancy, sexual orientation, or gender identity), age, national origin or ancestry, physical or mental disability, veteran status, marital status, genetic information, HIV-positive status, as well as any other characteristic protected by federal, state, or local law. One of Hays' guiding principles is 'do the right thing'.
We also believe that actions speak louder than words.
In that regard, we train our staff on ensuring inclusivity throughout the entire recruitment process and counsel our clients on these principles. If you have any questions about Hays or any of our processes, please contact us.

In accordance with applicable federal, state, and local law protecting qualified individuals with known disabilities, Hays will attempt to reasonably accommodate those individuals unless doing so would create an undue hardship on the company. Any qualified applicant or consultant with a disability who requires an accommodation in order to perform the essential functions of the job should call or text .

Drug testing may be required; please contact a recruiter for more information.

#LI-DNI