Azure Databricks Engineer - Contract - Remote - $65.00 - $70.00/hr.
The final salary or hourly wage, as applicable, paid to each candidate/applicant for this position is ultimately dependent on a variety of factors, including, but not limited to, the candidate's/applicant's qualifications, skills, and level of experience as well as the geographical location of the position.
Applicants must be legally authorized to work in the United States. Sponsorship not available.
Our client is seeking a Azure Databricks Engineer in for a remote opportunity.
Role Description
Azure Databricks Engineer who will work with existing staff to plan and design ETL pipelines and product solutions using Azure Databricks. The person filling this role will create resilient processes to ingest data from a variety of on-prem and cloud transactional databases and APIs. Responsibilities will also include developing business requirements, facilitating change management documentation, and actively collaborating with stakeholders. This individual will work closely with a development technical lead and discuss all aspects of the design and planning with the development team.
Research and engineer repeatable and resilient ETL workflows using Databricks notebooks and Delta Live Tables for both batch and stream processing
Collaborate with business users to develop data products that align with business domain expectations
Work with DBAs to ingest data from cloud and on-prem transactional databases
Contribute to the development of the Data Architecture
By following practices for keeping sensitive data secure
By streamlining the development of data products for use by data analysts and data scientist
By developing and maintaining documentation for data engineering processes
By ensuring data quality through testing and validation
By sharing insights and experiences with stakeholders and engineers
Now they are looking to scale, working toward a demo with the business data governance team, team of engineers to interface with data team to show the platform then collect use cases for what ever needs to be ingested in Databricks.
Empower teams to use Databricks in their jobs for a variety of reasons.
Figure out policy for the State then help them implement the policy.
Next task is to enable business to use databricks then continue to ingest new data. Currently performance tuning and maintenance. Tune stuff now so they don't blow up the budget. Could be useful in hiring someone who can make suggestions on how to save time and money.
Other time spent meeting with stakeholders (no paid training for contractors) Spark API
PySpark
Currently 2 developers on the team (Nathaniel & 1 other with C# background who is filling some of the data engineering); 1 Platform engineer; 1 PowerBI contractor (does not report to Nathaniel but is on the dev team)
Primarily Dept of Highway - State Hwy Patrol is splitting
Nathaniel is part of Web Service Team reports to Bruce Peterson & James Merricks
1 Per in DOH and 1 in DMV for Web Services team, they were traditionally backend services group.
Skills & Requirements
Devops - understand backlog items, tasks, committing meaningful commits, pull requests - not writing or creating CI/CD - he has a platform engineer creating CD
Familiar with SDLC
2 years experience required: Azure Databricks Delta Live Tables
Must be able to write easy-to-follow databricks notebook code - ideal if they have come from a software development background and ideal if they've had some project management related duties in past jobs too.
2 years experience in Spark and Databricks SQL/PySpark
2 years; data engineering best practices; data warehouse, data lakes, and the Delta lake architecture
ETL Development - understand the fundamentals of data ingestion
2 years experience/in depth knowledge of OLTP and OLAP systems, Apache Spark, and streaming products like Azure Service Bus
Problem solver. Curious about where the data is coming from.
Must be able to work remotely (the office is available for them to go onsite if they choose).
Must be able to communicate effectively to work with cloud and database teams
PySpark, Spark API, Azure DevOps
Desire to have strong knowledge in OO code like Java, Python, C++)
Benefits/Other Compensation
This position is a contract/temporary role where Hays offers you the opportunity to enroll in full medical benefits, dental benefits, vision benefits, 401K and Life Insurance ($20,000 benefit).
Why Hays?
You will be working with a professional recruiter who has intimate knowledge of the industry and market trends. Your Hays recruiter will lead you through a thorough screening process in order to understand your skills, experience, needs, and drivers. You will also get support on resume writing, interview tips, and career planning, so when there's a position you really want, you're fully prepared to get it.
Nervous about an upcoming interview? Unsure how to write a new resume?
Visit the Hays Career Advice section to learn top tips to help you stand out from the crowd when job hunting.
Hays is committed to building a thriving culture of diversity that embraces people with different backgrounds, perspectives, and experiences. We believe that the more inclusive we are, the better we serve our candidates, clients, and employees. We are an equal employment opportunity employer, and we comply with all applicable laws prohibiting discrimination based on race, color, creed, sex (including pregnancy, sexual orientation, or gender identity), age, national origin or ancestry, physical or mental disability, veteran status, marital status, genetic information, HIV-positive status, as well as any other characteristic protected by federal, state, or local law. One of Hays' guiding principles is 'do the right thing'.
We also believe that actions speak louder than words.
In that regard, we train our staff on ensuring inclusivity throughout the entire recruitment process and counsel our clients on these principles. If you have any questions about Hays or any of our processes, please contact us.
In accordance with applicable federal, state, and local law protecting qualified individuals with known disabilities, Hays will attempt to reasonably accommodate those individuals unless doing so would create an undue hardship on the company. Any qualified applicant or consultant with a disability who requires an accommodation in order to perform the essential functions of the job should call or text .
Drug testing may be required; please contact a recruiter for more information.
#LI-DNI
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 80144310
- Position Id: 1180604
- Posted 1 day ago
Never miss an opportunity! Create an alert based on the job you applied for.
