Sr. Data Engineer (remote)

Great opportunity for this industry leading retail organization experiencing dynamic growth and a reputation for being an exceptionally EMPOYEE ORIENTED work environment!!

Join a growing team of data experts with responsibility for optimizing data flow and collection while growing and optimizing data and data pipeline architectures. You will be supporting data analysts/scientists on data initiatives to ensure optimal data delivery architecture is consistent throughout the enterprise. Great opportunity to support the data needs of multiple teams, systems and products, including the redesign of the data architecture to support the next generation of products and data initiatives.

RESPONSIBILITIES

• Collecting, organizing, managing, and converting raw data into a format that can be easily analyzed by Business Intelligence analysts and data scientists.
• Build and maintain data pipelines that collect and transport data from various sources to data storage systems.
• Use algorithms and programming languages such as SQL and Python to prepare data for analysis.
• Work closely with the business to understand and address business requirements related to data storage, management, and analysis.
• Create data analysis tools and develop new data validation methods to ensure accuracy and completeness.
• Identify ways to make data more reliable, efficient, and accessible to relevant stakeholders.
• Conduct research to address potential issues in data storage and management systems.
• Help design a modern Data and Information Delivery and Analytics platform in the cloud to support service and product distribution.
• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional/non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders to assist with data-related issues and support their data needs.

BACKGROUND

• Senior level experience with commercial data engineering/science solution initiatives.
• Strong experience using and strategizing the use of DBT and Airflow.
• Strong experience with SQL with understanding of datastores and their tradeoffs (including relational, columnar, and document stores), data modeling, data structures, data manipulation.
• Strong knowledge of ETL pipeline design, tooling, and support.
• Solid experience designing, building and optimizing big data data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Senior level analytic skills related to working with unstructured datasets.
• Strong experience building processes supporting data transformation, data structures, metadata, dependency and workload management.
• Verifiable experience architecting, implementing, and optimizing high throughput data pipelines.
• Strong experience deploying production systems in the cloud (i.e., AWS, Azure).
• Storage: Snowflake, AWS Storage Services (e.g., S3, RDS, Glacier)
• Strong experience with ETL/BI: Astronomer, DBT, Domo, Tableau, PowerBI

RedRiver offers benefits including Major Medical, Dental, Vision, LTD and 401k. More positions @: RedRiver Systems is an Equal Opportunity Employer.