Summary
Job Title: Sr Azure Data Engineer
Location: Remote
Duration: 8 Months + Extension
Bill Rate: $85/hour
Job Type: C2C/1099 Contract
Client: To Be Discussed Later
Work Authorization:
Job Description:
We are looking for a skilled Sr. Data Engineer- Azure Databricks to join our Data & Analytics team in the US. The ideal candidate will have extensive experience in data engineering, working with Databricks and Azure cloud services, designing and implementing scalable Azure Cloud data solutions. You will play a crucial role in the development, optimization and maintenance of data pipelines and architectures, ensuring the quality and the availability of critical data through our Data Lake platform. You can work independently and as part of a team, with a strong desire to help shape our Data & Analytics platforms and strategy.
Responsibilities:
- Data Pipeline Engineering: Design, develop, and deploy robust and scalable data pipelines using Databricks, integrating data from various sources (databases, APIs, streaming platforms, etc.), transforming and cleaning data using SQL or Scala/Python and loading data into target systems (data lakes, data warehouses, etc.). Optimize pipeline performance for greater efficiency and cost-effectiveness.
- Databricks Expertise: Use all the capabilities of the Databricks platform, including Databricks SQL, Delta Lake, Databricks Runtime, and Databricks Workflows, to orchestrate complex data workflows and ensure data quality and pipeline reliability.
- Data Architecture and Modeling: Contribute to the design and implementation of robust data models in the data lake environment, ensuring data consistency, integrity and accessibility for various use cases.
- Data Quality Assurance: Implement rigorous data quality controls and validation procedures throughout the data pipeline to ensure high accuracy and reliability. Comply with the data governance policies and best practices.
- Cloud Integration: Seamlessly integrate Databricks with Azure cloud services for storage, compute and security, leveraging services like Azure Data Lake Storage.
- Continuous Learning: Stay up to date on the latest Databricks features, cloud technologies, and data engineering trends to continuously improve our solutions and deliver innovative results for our business.
- Collaboration and Communication: Work closely with data analysts, IT Front Line and business stakeholders to understand their data requirements and provide technical expertise on Databricks and data engineering best practices.
Equal Opportunity Employer: We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.
Never miss an opportunity! Create an alert based on the job you applied for.
