SENIOR DATA ENGINEER

CLOUD, ETL
Contract W2
Depends on Experience

Job Description

REQUIRED SKILLS

 

  • 5+ years of experience in a data/cloud engineering role
  • 5+ years of experience working and creating datasets for a data warehouse
  • Clear understanding of data modeling patterns (relational and dimensional)
  • Working knowledge and experience in using best practices in designing, building, and managing data pipelines that require data transformations as well as metadata and workload management
  • Working knowledge and experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional and new data integration technologies (such as ETL, ELT, data replication, change data captures, message-oriented data movement, API design, stream data integration and data virtualization)
  • Working knowledge and experience in performing root cause analysis on internal and external data and processes to identify issues and opportunities for improvement
  • Ability to read and write SQL, PL/SQL, and/or T-SQL
  • Hands on experience with scripting languages, such as Python, R, Java, Scala, etc.
  • Knowledge of data storage concepts, such as databases, data warehouses, and data lakes
  • Relational SQL databases, such as Oracle and SQL Server
  • Experience with and understanding of continuous integration and continuous deployment practices
  • Agile Experience

 

PREFERRED SKILLS

  • 3+ years of experience with ETL development tools, Informatica or Azure Data Factory (ADF)
  • 3+ years of cloud experience, Azure
  • Experience with NoSQL databases

 

  • Bachelor of Science in Computer Science, Information Technology or equivalent

Experienced in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional and new data integration technologies (such as ETL, ELT, data replication, change data captures, message-oriented data movement, API design, stream data integration and data virtualization)

  • Manages and develops data processing and assigns customers to marketing segments in the CDP; using demographic data, behavioral data, and intent signals and works with data scientists to incorporate machine learning outcomes into the overall customer segmentation model
  • Experience with streaming technologies (Kafka, Pubsub, Kinesis) and log-based architectures and experience writing batch and stream processing jobs (i.e. Apache Beam, Google Cloud DataFlow, Apache Spark, Apache Storm)
  • Experienced in performing root cause analysis on internal and external data and processes to identify issues and opportunities for improvement
  • Expert level knowledge with programming languages including SQL, PL/SQL, T-SQL
  • Expert level knowledge with relational SQL databases such as Oracle and SQL Server
  • Experience with a scripting language: Python, Java, Scala, etc.
  • Strive to provide orientation and direction to junior engineers requiring their expertise
  • Experienced wfunctional business requirements
  • Create, maintain, and reuse existing ETL/ELT processes, employing a variety of data integration and data preparation tools
  • Mentor engineers in finding optimal and efficient solutions for designing, preparing, and storing data for analytical and operational use cases.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing pipelines for greater scalability, etc.
  • Work with stakeholders including Product, Data and Business teams to assist with data-related technical issues and support their data needs
  • Create datasets for: (1) operational reports, key performance indicators/metrics, or other insights into current organizational activities, (2) analytics and data science to provide the ability to uncover the answers to major questions that help organizations make objective decisions and/or gain a competitive edge
  • Write, debug, and implement complex queries involving multiple tables or databases across platform(s)
  • Collaborate with the Enterprise Architecture team to ensure alignment on data standards and processes
  • Work with data and analytics experts to strive for greater functionality in data systems

 

Dice Id : 10111611
Position Id : 7445952
Originally Posted : 3 months ago
Have a Job? Post it

Similar Positions

Data Engineer I
  • Bankunited
  • Miami Lakes, FL, USA
Data Services Engineer
  • Jobot
  • Miami, FL, USA
Senior Data Analyst
  • JM Family Enterprises
  • Deerfield Beach, FL, USA
Data Engineer
  • JM Family Enterprises
  • Deerfield Beach, FL, USA
SAS Data Analytics Engineer
  • Kforce Technology Staffing
  • Davie, FL, USA
Tech Lead/Sr. Software Engineer
  • Santander Holdings USA Inc
  • Hollywood, FL, USA
Tech Lead/Sr. Software Engineer
  • Santander Holdings USA Inc
  • Davie, FL, USA
Data Engineer
  • TekPartners
  • Deerfield Beach, FL, USA
Tech Lead/Sr. Software Engineer
  • Santander Holdings USA Inc
  • Fort Lauderdale, FL, USA
Data Engineer
  • Symbiotic Consulting Group
  • Deerfield Beach, FL, USA