Sr. Data Engineer will be responsible for developing curated data (data models, data ETL pipelines, views) in a cloud-based environment to support business needs for analytics and reporting. The engineer will assist an existing team with migration from on prem to cloud-based data delivery platform and should have experience in migration of environments. The candidate will provide guidance and support for the set-up of the new environment along with best practices and recommendations based on industry and hands on experience as a data engineer. In addition, the candidate should have experience with standardizing data modeling and design frameworks for analysis, design, building, testing and maintenance. Cloud based data engineering is required and experience using the Azure stack is highly preferred and recommended. Candidates must possess the technical capabilities to extract, retrieve and analyze data with SQL based tools. The engineer should possess strong interpersonal communication skills to be able to bridge the gap between business and technical users to understand and assess requirements and deliver data driven solutions. The role will also involve adhering to data governance standards and practices along with experience developing in an agile environment using Azure boards or similar tool such as Azure Dev Ops.
● Responsible for eliciting, understanding, interpreting and representing business requirements.
● Act as the conduit between the customer and technical teams to ensure requirements are understood.
● Responsible for understanding business processes to develop business models.
● Provide subject matter expertise on the use of data as well as educate teams on business model, metadata and standards.
● Responsible for understanding source systems and its data models.
● Develop source to target mappings for data lineage.
● Document source architecture to include data flows.
● Responsible for analyzing data to validate business domains and requirements.
● Responsible for data profiling and ensuring data quality requirements are accurate and complete.
● Act in an advisory capacity in data model reviews, architecture approach and solution design to ensure high quality deliverables.
● Responsible for partnering with management and business units on innovative ways to successfully utilize data and related tools to advance business objectives.
● Responsible for providing day-to-day support, troubleshooting and incident management and resolution.
● Responsible for communicating planned and unplanned activities to appropriate parties as needed.
● Provide ad hoc support for Business reporting requests
Requirements
● Bachelor’s degree or equivalent plus 7 years of related professional experience. Degree in technology related area preferred.
● 5+ years experience as a Data Engineer/Analyst, specifically utilizing Azure Data & Analytics PaaS Services (Azure Data Factory, Azure Data Lake, Azure SQL DW)
● 5+ Experience with JSON
● 5+ years hands-on experience working with SQL.
● 5+ years experience with data modeling concepts and techniques.
● 5+ years experience of hands-on with Informatica Power Center and IICS development
● Strong experience building data pipelines to bring together information from different source systems.
● Strong NoSQL experience with CosmosDB
● Experience working with Microsoft Power Platform (PowerBi, PowerApps, PowerAutomate) a plus
● Well versed in data management concepts, data lifecycle and methodologies.
● Must exhibit strong thought leadership.
● Skillful at applying business and technical skills to drive innovation and performance improvement.
● Excellent analytical, problem-solving, and decision-making skills, leveraging both logic and creativity.
● Excellent written and oral communication, as well as, good organizational and presentation skills.
● Demonstrated ability to handle multiple competing priorities in a dynamic environment.
● Demonstrated facilitation and meeting management skills.
● Demonstrated ability to understand the unique needs of the customer and translate to actionable results while delivering high quality outcomes.
● Ability to influence and motivate individuals and teams to drive mutually beneficial outcomes.
● Excellent interpersonal skills with the ability to build relationships within and between individuals and cross-functional teams.
● Must enjoy working in a team-oriented, collaborative environment as well as autonomously.
● High achievement orientation with a willingness to learn.
● Possess a solid overall understanding of technology concepts, trends, and capabilities.
● Exhibit a strong desire to understand the organization, its industry, and its strategies.
● Working knowledge of project management principles, a plus.
● Must exhibit strong customer service orientation.
● Must be willing to be on-call as needed.
Never miss an opportunity! Create an alert based on the job you applied for.
