Databricks

Location: BOYNTON BEACH, FL
Duration: 6 months

Competencies: 8-10+ years experience required
Digital : Databricks
Digital : PySpark

Role Description:

Must-Have Competencies:
Designing and implementing highly performant data ingestion pipelines from distributed systems using Apache Spark and Databricks
Experience in data architecture principles and practices
Highly proficient with PySpark, and PLSQL
Hands on experience in building ETL data warehouse transformation processes
Strong experience with Big Data, Data analysis with excellent analytical and problem-solving abilities
Hands on experience in Big Data components such as Spark SQL, Data frames, HIVE etc. implemented using Data Bricks.
Hands on experience on Cloud based environments - AWS preferred.
Hands on experience in building pipelines in Databricks.
Hands on experience in building relational and dimensional data model
Very strong SQL and data analysis skills
Understanding of Databricks-AWS integrations, Delta Lake on AWS S3.
Technical expertise regarding data models, database design development, data mining and segmentation techniques.
Excellent technical, diagnostic, and troubleshooting skills.
Strong leadership and organizational abilities.
Ability to multitask and work under pressure.
Good leadership skills.
Highly motivated and willing to learn new technologies.
Keeping up to date with industry trends and developments.
Effective communication and interpersonal skills.

Good-to-Have:
Exposure to Data Vault Modelling.

SN Responsibility of Expectations from the Role:
Oversee the technical team and all projects they undertake.
Takes the lead role in requirements analysis and solution design (high level and low level) of a varied portfolio of design initiatives.
Assume responsibility for all design artifacts, data flow diagrams and produce the conceptual, logical, and physical data models.
Contribute to strategic product roadmap definition and delivery.
Determining project requirements and developing work schedules for the team.
Engage with key stakeholders throughout the organization to ensure the solutions we are accountable for meet the current and future business demand.
Assist Product Owner to define use cases, requirements, and project planning.
Providing technical direction, mentoring and best practices to both onshore and offshore Teams.
Collaborating with the team to identify and fix technical problems.
Should be able to work with team and inspire them to reach their goals.
Communicating with the clients to ascertain their needs.
Connect with client team and Business team to gather project requirement.