Overview
Remote
Depends on Experience
Contract - W2
Able to Provide Sponsorship
Skills
DBT
Databricks
Job Details
Job Title Data Engineer (DBT, Databricks & SQL)
Location: Remote
Essential Duties & Responsibilities
Location: Remote
Essential Duties & Responsibilities
- Development and maintain SQL and python jobs for data extract, transformation and loading based on defined requirements for the data pipelines.
- Develop and maintain a python framework for data ingestion from multiple source systems like sql server, SAS, salesforce, etc.
- Strong Experience with SQL
- Communicate with product teams and understand data requirements.
- Identify, analyze, and interpret trends or patterns in complex data sets.
- Develop and implement metadata, error logging, and audit for pipelines and other strategies that optimize efficiency and quality.
- Support the bug fixing and performance analysis for data pipelines.
- Working experience of ingesting data into cloud databases like snowflake.
- Analyze and manage 3rd Party and other external data sets.
- Follow an agile development methodology.
- 3 years Python experience in data warehousing projects
- 3-4 years experience in SQL, expert in at least one database. Snowflake experience preferred.
- 2+ years experience in ETL or ELT tool
- 2+ years experience in years Agile environment
- 2+ years experience in git source control (github, gitlab, bitbucket)
- Build ETL jobs and streaming processes based on jointly defined requirements for the data pipeline.
- Identify, analyze, and interpret trends or patterns in complex data sets.
- Support the bug fixing and performance analysis along the data pipeline.
- Analyze and manage 3rd Party and other external data sets.
- MS Office (word, teams, excel), experience with confluence.
- Strongly preferred: Snowflake, SQL Server
- Self-starter, Self-reliant, and thorough knowledge in SDLC
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.