Overview
On Site
Accepts corp to corp applications
Contract - W2
Contract - 6+ month(s)
Skills
Azure
Python
Spark
Databricks
Apache
Job Details
- Strong experience building and leading highly complex, technical engineering teams.
- Strong hands-on experience in Databricks
- Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
- Experience managing distributed teams preferred.
- Comfortable working with ambiguity and multiple stakeholders.
- Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
- Expertise on Azure Cloud platform
- Good SQL knowledge
- Knowledge on orchestrating workloads on cloud
- Experience with Unity Catalog
- Ability to set and lead the technical vision while balancing business drivers
- Strong experience with PySpark, Python programming
- Proficiency with APIs, containerization and orchestration is a plus
- Experience handling large and complex sets of data from various sources and databases
- Solid grasp of database engineering and design principles
- Familiarity with CI/CD methods desired
- Good to have Teradata Experience (not Mandatory)
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.