Overview
On Site
$60 - $70
Contract - W2
Contract - 12 Month(s)
Skills
Azure Databricks and python and pyspark
Job Details
Job Description:
Notes::
Looking for:
Great SQL, Python and pyspark skills
Preferably experienced with Databricks
Basic Qualifications:
- Bachelor s degree or equivalent in Computer Science, Mathematics, Software Engineering, Management Information Systems, Computer Engineering/Electrical Engineering, or any Engineering field or quantitative discipline such as Physics or Statistics.
- Minimum 6 years of relevant work experience in data engineering, with at least 2 years in a data modeling.
- Strong technical foundation in Python, SQL, Spark/Pyspark and experience with cloud platforms (for example, AWS, Azure,).
- Deep understanding of data engineering fundamentals, including database architecture and design, Extract, transform and load (ETL) processes, data lakes, data warehousing, and both batch and streaming technologies.
- Experience with data orchestration tools (e.g., Airflow), data processing frameworks (e.g., Spark, Databricks), and data visualization tools (e.g., Tableau, Power BI).
- Proven ability to lead a team of engineers, fostering a collaborative and high-performing environment.
- Good communication, interpersonal, and presentation skills, with the ability to effectively communicate with both technical and non-technical audiences.
Extra Credit:
- Experience with Databricks platform.
- Experience with CDP platforms like HighTouch.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.