Overview
Skills
Job Details
Job Title: Data Engineer
Duration; 1 Year
Location: Framingham, MA (100% Remote)
Job Description :
The Data Engineer is accountable for designing, creating, and maintaining data pipelines and data models (using various data preparation and storage technologies) for the for Projects for the Risk Assurance Data and System.
You are expected to work as our lead engineer partner with our Data Analysis, IT Teams, partner and developers to drive the design and overview the technical side of the delivery
Key Responsibilities & Tasks:
Accountable for designing, developing, testing, cataloging, and maintaining Data Software and Data Pipeline solutions for the Corporate Risk and Compliance functions
Analyze raw data / data sets in various data technology environments
Combine raw information from different sources and technologies
Identify opportunities for data acquisition
Work collaboratively with IT teams and peer engineers to ensure data duplication is minimized and solutions are aligned to the overall strategic IT roadmap.
Accountable for delivering clean, secure, performant code/technology components that meet all the non-functional requirements
Participate in Design Reviews, peer code reviews and Impact Assessment Sessions to identify appropriate solutions
Creates test data, relevant supporting documentation and supports deployment, for small to medium complex solutions
Comfortable working within an agile framework to ensure solutions are delivered efficiently - identify opportunities to improve the development process
Supports discussions on design approaches to solving business problems
Maintains broad knowledge in Data sources and Analytics applications/self-service areas which support the Corporate Risk and Compliance function
Works with the COE to enhance guidelines, standards, and methodologies - partner with peers to ensure consistency
Actively participate in the appropriate communities of practice
Assumes responsibility for providing a high level of customer service and takes personal accountability for outcomes
The ability to multitask and prioritize work in a fast-paced environment
Accountable to leading our data related design, modeling, and data solution delivered and proactively address issues that are identified.
Assumes responsibility for providing a high level of customer service and takes personal accountability for outcomes
Leading other developers and analyst through design concepts
Excellent teamwork, interpersonal, and communication skills
Ability to develop relationships at all levels of the business
The ability to multitask, prioritize and work in a fast-paced environment
Experience (Requirements):
Good experience (5-10 years) in a technical data, data modeling, and/or data analytics role, specifically in technical design, development, and implementation
5-10 years' experience as a data engineer/modeling or in a similar role
Experience in the retail industry - understanding of purchase orders & sales, vendor maintenance, merchandising, etc.
Good knowledge of Excel, Power BI, Snowflake, Jira, Confluence, Databricks & Alteryx
Experience to understand the reporting requirements and build out data models for reporting in Power BI and Snowflake
Expert knowledge of and experience with a Data modeling and Engineering toolset, SQL, Data Modeling, multiple file formats (JSON, XML, etc), data security and data profiling
Proficient in working with SQL and creating stored procedures and other integration techniques
Some experience with cloud data storage technologies (Azure), analytics tools, end-to-end data architecture patterns and data governance concepts
Experience in the full software delivery lifecycle on business development projects including data analysis, process mapping, business requirements, solution design, functional and technical specification, coding, source code management, test plans, and go-live release notes
Familiar with Agile and DevOps concepts and tools
Good analytical, critical thinking & influencing skills
Key Skills, Knowledge & Experience (Preferences):
Bachelor's degree in information management, data analytics, computer science, or a similar field
Expertise and hands-on experience working with complex and large data sets in a multi-system and technology environment (this can be built with IT support)
Python skills