Data Engineer/Architect

Job ID: NC-764981

Hybrid/Local Govt Data Engineer/Architect (MS/Azure/15+) with SSIS, Parquet, DB2/SQL Server, dagta quality/security/conversion/Cleansing/Migration/governance, QA, and ETL/ELT experience

Location: Raleigh, NC (NCDOT)
Duration: 12 Months
Position: 1(2)
***This is a hybrid position. The candidate could be required onsite 2-3 days per week

Skills:
Database Design Required 10 Years
SQL Server, DB2 experience. Required 10 Years
Database back up, maintaining table partitions Required 5 Years
Database Conversion, Cleansing, Migration Required 10 Years
Application development or application support or application testing or a combination of those experiences. Required 10 Years
Software development lifecycle methodologies Required 10 Years
Ability to create and maintain required documentation. This includes documenting customer requirements, design flows and systems flow. Required 10 Years
Leading or Supervising an IT Team Required 5 Years
Written and verbal communications are clear, concise and achieve intended objectives Required 10 Years
Problem Diagnosis skills [i.e., discovery, replication, troubleshooting, resolution, verification, communication and/or escalation as required] Required 10 Years
Experience with writing test cases, executing those cases and leading technical training Required 10 Years
BS/BA degree in Computer Science, Information Technology, Computer Engineering; MS degree in Computer Science or equivalent or an MBA Required 5 Years
MS Azure or MS Cloud certification Highly desired 2 Years
SQL Server SSIS management and/or framework Highly desired 2 Years
Parquet text maintenance knowledge Nice to have 2 Years
Must reside in North Carolina and can report on-site at short notice Required

Job Description:

The Sr. Data Solutions Engineer role will aid in the development of a new cloud environment by assisting the NCDIT DMV Modernization Team with the design, management, and maintenance of data flow as it pertains to cloud technology. Additionally, this role will also be responsible for data analysis, data profiling, data cleansing, data governance, in preparation for data conversion of the existing environment. The ideal candidate will be able to develop & maintain cloud data strategy, evaluate data elements and structure, and ensure the smooth integration of data internal and external to cloud initiatives. This position will direct a team two database programmers to complete the data analysis. Additionally, the position will assist in a leadership role:

Execution of cloud design and implementation strategies.
Evaluation and selection of the appropriate data frameworks.
Establishment of standards, best practices for data conversion, data mapping, data cleansing, and data migration as it evolves from legacy to cloud-based technologies.
Design of system integration containing database permissions, keys, and access for authorized data usage and reporting.
Process Instruction of infrastructure movement techniques and data transfers using multiple ETL/ELT sources.
Responding to technical issues timely and effectively.
Leading and solicit database programmers, application teams, security, and infrastructure teams to monitor cloud privacy, performance, and load.
Capturing lessons learned and transitional knowledge to assist the Leadership Team in establishing a mentoring path that provides technical exposure and develops the next generation of DIT leaders and technical staff.
Additional Roles and Responsibilities
The Sr. Data Solutions Engineer position will also serve in a lead role in the application support team s quality assurance for operations and maintenance initiatives. The resource will serve as Subject Matter Expert (SME) with the following expected responsibilities:
Lead the design of data conversion, cleansing, migration, and frameworks while ensuring security and data integrity.
Design and enforce policies based on Data Quality, Data Security, Data retention, Data Stewardship.
Document the data model & data mapping, create a data dictionary, define columns and data relationships.
Maintain the end-to-end vision of the data flow diagram and develop logical data models into physical data repositories.
Use data cleansing & governance tools to administer, manage and script database functions based on user inputs and data quality principles.
Design and deliver Data integration solutions based on current DB2 and future Microsoft SQL Server systems.
Identify project impacts on Business Process Models for our business stakeholders as it relates to Software Development Lifecycle methodology.
Coordinate with all other solution architects to assist the Enterprise Services Team with the delivery of software solutions.