Data Bricks Engineer

Overview

Hybrid
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent

Skills

AWS
databricks
ETL & Python

Job Details

Responsibilities:

      • Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization.
      • Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services.
      • Design, develop and manage the pipelining (collection, storage, access), data engineering (data quality, ETL, Data Modelling) and understanding (documentation, exploration) of the data.
      • Interact with stakeholders regarding data landscape understanding, conducting discovery exercises, developing proof of concepts, and demonstrating it to stakeholders.

Requirements:

    • Has more than 2 Years of experience in developing data lakes, and datamarts on the Databricks platform.
    • Proven skill sets in AWS Data Lake services such as - AWS Glue, S3 Lambda, SNS, IAM, and skills inSpark, Python, and SQL.
    • Good understanding of developing data warehouses, data marts, etc.
    • Has a good understanding of system architectures, and design patterns and should be able to design and develop applications using these principles.
    • Good collaboration and communication skills
    • Excellent problem-solving skills to be able to structure the right analytical solutions. Strong sense of teamwork, ownership, and accountability
    • Analytical and conceptual thinking
    • Ability to work in a fast-paced environment with tight schedules.
    • Good presentation skills with the ability to convey complex ideas to peers and management.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.