Sr Data Engineer

Overview

Remote
Depends on Experience
Contract - W2
Contract - 12 Month(s)

Skills

snowflake
datadog
python
airflow
dbt
etl
sql
devops
aws

Job Details

About the Role

We're seeking a talented, creative, and motivated Senior Data Engineer who loves to build data platform tools and is ready to work with a team of individuals who share your passion. With a related degree under your belt--and relevant experience--you re ready to take your programming and data knowledge to the next level. You enjoy building tools such as Data Ingestion Service to ingest data from diverse sources to Data Platform, building tools for monitoring & observability. With your unwavering commitment to quality, excellent data/cloud skills, and collaborative work ethic, you ll do great things here at the client

What you ll do:

  • You ll work with other Data Engineers for the build-out of the Next Generation Data Platform.
  • You ll collaborate with various teams to provide guidance on best practices for utilizing the Cloud Data Platform.
  • You ll be working on latest Cloud Data Warehouse Platform (Snowflake) and developing Data Marts using Python and SQL.
  • You ll work with the team to design and develop a Data Catalog Service using Snowflake Horizon and Polaris.
  • You ll work with the team to design and develop Data Observability using DataDog and Data Recon to detect data anomalies.
  • You will design and develop a CI/CD process for continuous delivery in AWS Cloud and Snowflake.
  • You ll design, develop, and test robust, scalable data platform components

About you

The ideal candidate will possess extensive experience in building data platform at enterprise scale. You will possess strong analytical skills, attention to detail, and the ability to thrive in a fast-paced environment. Excellent communication and collaboration skills are essential to communicate with technical & non-technical partners. The candidate must demonstrate a proactive and results-driven approach to problem-solving, with a focus on driving continuous improvement and innovation in data quality and operational processes.

If you are eager to shape the next generation of data foundations in the real estate industry and make an impact, join us in an extraordinary world-class data and analytics organization and become part of the digital transformation client is leading.

Your Experience

  • Bachelor s in computer science, Engineering, or related technical discipline or equivalent combination of training and experience
  • 5+ years programming experience: building application frameworks, and back-end systems for high-volume pipelines using Python.
  • Strong knowledge of SQL for querying, data manipulation, and data transformation
  • Understanding of dimensional modeling, star schemas, and data partitioning techniques
  • 2+ years experience with the Cloud Data warehousing services, including storage options, compute capabilities, and data management tools
  • 3+ years experience using Orchestration tools like Airflow or dbt
  • 2 years experience using AWS Data Services: S3, Cloudformation, EMR
  • 2 years experience building Data Observability tools like DataDog or any other tool .
  • 3+ year exp. with data architecture, ETL and processing of structured and unstructured data
  • 3+ years experience with DevOps tools (any combination of GitHub, TravisCI or Jira) and methodologies (Lean, Agile, Scrum, Test Driven Development)

Behavioral Competences

  • Excellent communication ability to communicate on different levels of seniority.
  • Team player; enjoying being part of a cross-functional setup.
  • Ability to perform well on time-critical endeavors and on multiple fronts at the time.
  • Strong dedication to quality and a 'client' mindset.
  • A passion for learning and continuous improvement.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.