Data Engineer

Overview

On Site
BASED ON EXPERIENCE
Full Time

Skills

DATA ENGINEER
DATA ENG
DATA ENGINEERING
SSIS
ETL
ELT
AZURE
DATA FACTORY
TABLES
VIEWS
QUERIES
STORED PROCEDURES
STORED PROC
STORED PROCS
DATABRICKS
DATA BRICKS
SQL

Job Details

About the Role:

We are seeking a highly skilled Data Engineer to design, develop and maintain databases in SQL Server and Azure, and data integrations in SSIS and Azure Data Factory. This role will be responsible for connecting and integrating data primarily from the NetSuite ERP system into SQL Server, as well as Azure-based Data Warehouse and Data Storage as the Company transitions to cloud-based technology. This role will participate in Data Warehousing design, strategy and implementation. The Data Engineer will collaborate with Data Architects, Engineers, Scientists and other IT teams to deliver scalable, reliable, accurate and high-performance data solutions.

Key Responsibilities:

  • Design, maintain and deploy SSIS packages that support data integration from NetSuite ERP and other systems to an operational data store and Data Warehouse.
  • Design and create tables, views, queries, stored procedures for optimized performance, ensuring data integrity and security.
  • Design, build and maintain data pipelines using Azure Data Factory, Databricks, Synapse Analytics, including ETL/ELT processes.
  • Ensure seamless integration between NetSuite ERP, SQL, Azure based resources, and other business applications.
  • Import and integrate external data sources, including market and commodity data, to support business intelligence and analysis of market conditions, trends, and forecasts.
  • Use Azure DevOps best practices and tools, including CI/CD pipelines.
  • Adhere to established database standards.
  • Stay updated with emerging technologies and trends to continuously improve data architecture, engineering and analytics capabilities.
Qualifications:
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or related field or equivalent experience.
  • 7+ years of experience with SQL server, including 5+ years of experience with SSIS and DevOps.
  • Expertise in using Visual Studio for Source Control and development and deployment of SSIS solutions.
  • Expertise in SSIS, not limited to merge/join/expressions, variables, parameters and error handling.
  • Familiarity with the project deployment model, use of package parameters and the Integration Services Catalog.
  • Experience in designing and developing data transformation solutions using a variety of SSIS components.
  • Experience in Azure Data Factory, Databricks, Synapse Data Warehouse and Power BI.
  • Strong experience in SQL, ETL/ELT development, and data modeling (Star Schema, Snowflake Schema, etc.).
  • Effective communication and collaboration skills, with the ability to work across teams and influence stakeholders.
Preferred Qualifications:
  • Knowledge of NoSQL databases and data lake architectures.
  • Experience working in Agile/Scrum environments.
  • Experience with Azure DevOps.
  • Certifications in Microsoft Azure Data Engineering or related disciplines.
What We Offer:
  • Competitive salary and benefits package.
  • Opportunities for professional growth and collaboration with industry leaders.
  • Ability to influence key technology decisions within a dynamic organization.
  • Collaborative and innovative work environment.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About EDI Specialists, Inc.