Enterprise network architect with Dept of Transportation exp (Onsite)

Position Description and Job Skill Set

• MDOT is seeking the services of one IT consultant to apply strong architectural, networking and application development skills to the analysis, design, development, integration, installation, implementation and support of their existing IT infrastructure. This consultant will resolve problems, which require an intimate knowledge of hardware, OS and application stack, including VMware, Cisco and HP servers and blade systems, Sun SPARC T5-2 and S7-2 systems, Oracle RAC, Dell/EMC products, and mainframe network technologies as well as a wide range of OS, DB and application expertise such as but not limited to, Oracle Linux and other distros, Sun Solaris 11, Windows Server (all versions), VMware vSphere (consisting of ESXi 5.5, though ESXi 8, vCenter 6.5 through 8 installations), Oracle 10g through 19c database environments, Microsoft SQL Server, and .NET technologies.
• Consultant will serve as MDOT's ITD/CVISN Systems Architect, to integrate and unify commercial vehicle registration, permitting and enforcement functions for the maintenance of ITD/CVISN Level 1 compliance for the State. Consultant shall provide architectural guidance and recommendation and also attend monthly ITD ACCB architecture meetings.
• Consultant will be responsible for archival data retrieval from the MDOT Automated Permit System (APS), a Visual FoxPro based commercial vehicle violation and permit issuance system in order to query, export and distribute archival data and also calculate statistics, financial recaps and other information as required by MDOT Permits, MDOT Financial Management Division and MDOT Legal Division and other entities.
• Consultant will be responsible for the operational management of approximately 500 intranet and internet- exposed Windows and Linux-based virtual and physical servers located statewide. Responsibilities will include deployment, AD management, provisioning, and troubleshooting of OS stack issues, such as OS, SQL, Oracle, web server, application and application performance, network, name resolution, storage and other issues as they arise.
• Consultant will be responsible for the operational management, troubleshooting and onsite and remote repair/upgrade of Dell/EMC Unity 480F, VPLEX VS2 and Isilon Gen 4, 5 and Gen 6 storage systems.
• Consultant will be responsible for the operational management, troubleshooting and onsite and remote repair/upgrade of Cisco UCS and HP servers, blade systems, Virtual Connect infrastructure and FC switches.
• Consultant will be responsible for the operational management, troubleshooting and onsite and remote repair/upgrade of VPLEX Metro.
• Consultant will be responsible for the operational management, troubleshooting and onsite and remote repair/upgrade of VMware vSphere installations located in the Jackson, MS area.
• Consultant will be responsible for the operational management, troubleshooting and onsite and remote repair/upgrade of Veeam v11 and v12+ Backup and Recovery systems.
• Consultant will be responsible for the operational management, including failover, troubleshooting and onsite and remote repair/upgrade of Sun T5-2 and Sun S7-2 servers, Solaris 11 and Oracle 12c in a RAC environment running MDOT's core Financial Management System (FMS) as well as other Oracle-based systems.
• Consultant will be responsible for the operational management, troubleshooting and onsite and remote repair/upgrade of HP MSL6480 LTO-7 tape libraries.
• Consultant will be responsible for onsite and remote network diagnostics and troubleshooting.
• Consultant will be responsible for onsite and remote datacenter failover processes and procedures (1 hour response required 24x7 in the event of both planned events and emergencies that require the complete or partial evacuation of a site).
• Consultant will be responsible for the onsite and remote maintenance, troubleshooting and repair of APC Symmetra PX and SUVT UPS power systems.
• Consultant will be responsible for troubleshooting of streaming video issues using in house developed monitoring tools and capacity scaling during peak demand.
• Consultant will be responsible for the data management and on site/remote device troubleshooting and repair of approximately 6 de-duplicated and non-de-duplicated DAS and iSCSI-connected storage repositories for production systems backups located in the Jackson, MS area.
• MDOT's IT infrastructure includes two datacenter locations housing HP BL460c Gen 8 blade servers running VMware ESXi and vCenter which are contained in Cisco UCS blades and HP blades with HP Virtual Connect storage connectivity virtualization through Dell/EMC MDS 9148T FC switches to Dell/EMC Unity 480F Flash SAN storage and HP Virtual Connect 10GbE connectivity to Cisco core switches. In addition to commercial storage products, MDOT also uses a similar approach to Fortune 500 technology companies building some hardware in-house. MDOT designs and builds custom high- performance storage and compute devices to meet specific requirements. These systems include high performance workstations, Fibre Channel block storage targets, and deduplication appliances using Windows/Linux and open source storage software.
• In addition, MDOT maintains an Oracle 12c RAC environment running on Sun T5-2 servers in separate datacenters. This environment hosts MDOT's critical Financial Management System (FMS) that is a core system.
• The SAN storage data is distributed as a synchronously, bi-directionally replicated, stretched cluster via Dell/EMC VPLEX Metro over redundant 100Gbps fiber between datacenters.
• These Jackson-area sites currently host approximately 500 Windows and Linux VMs. IT Consultant will be responsible for the installation, maintenance, upgrade, and troubleshooting of any and all aspects of this infrastructure and VM farm, including OS and application issues within the VMs themselves.
• Additionally, MDOT IT infrastructure includes two Gen 4, Gen 5 and Gen 6 Dell/EMC Isilon clusters containing production data as well as Veeam backup of VMs, with the data being partially replicated via SyncIQ and failover managed via Superna Eyeglass.
• IT Consultant will additionally be responsible for management and troubleshooting of backup issues, replication issues and capacity management, as well as Isilon-related issues including OneFS upgrades.
• MDOT also operates Traffic Management Centers (TMC) with approximately 1100+ remote camera sites that transmit video image data through the TMCs to physical and virtual servers located across the State. Virtualization includes Cisco UCS, HP DL380 and DL385 G7 G10+ servers, Dell/EMC SAN, Dell/EMC Unity 480F, VMware vSphere. IT Consultant will be responsible for the installation, maintenance, upgrade, and troubleshooting of any and all aspects of all hardware infrastructure and associated VM farms, including OS and application issues within the VMs themselves.
• MDOT maintains de-duplicated DAS storage repositories for SQL, Oracle, and certain Veeam server and workstation backup data. IT Consultant will be responsible for the installation, tuning, management and repair of approximately 6 storage systems located at 3 datacenter facilities located in the Jackson area. IT Consultant will be responsible for the management and maintenance of these systems.
• IT infrastructure support will occasionally include emergency response requiring IT Consultant to be available and present to respond to critical, time sensitive issues that involve IT infrastructure power and cooling problems as well as scheduled management tasks and maintenance. These tasks will require IT Consultant to occasionally be available and onsite both after hours and on weekends within an hour's notice in addition to being onsite during normal business hours.
• Emergency responses can include but are not limited to datacenter failover, powering down of compute and storage systems, monitoring of critical systems and recovery.
• Consultant will additionally serve as an ITD/CVISN (Innovative Technology Deployment/Commercial Vehicle Information Systems and Networks) Systems Architect, serving MDOT who is a stakeholder in this federally sponsored program to nationally integrate and unify commercial vehicle registration, permitting, and enforcement functions. Mississippi's ITD/CVISN Architect must have a strong background in systems analysis and design, as well as networking engineering and database analysis and design, and application design as required for the maintenance of CVISN Level 1 compliance for Mississippi. Consultant must have experience with ITD/CVIEW (Commercial Vehicle Information Exchange Window) databases and software including multi-Agency deployments of FMCSA systems including SafetyNet, SAFER Data Mailboxes, Aspen and other Federal systems.
• Consultant will be responsible for the maintenance, query development and execution, data export, report generation, and calculation of financial and statistical metrics from in-house developed systems used by the MDOT Permit Division and Financial Management Division, including the Automated Permit System (APS). These systems were developed in Visual FoxPro 6 and 7.
• Consultant will be responsible for the maintenance and update of SSL/TLS certificates installed in approximately 140 servers within the MDOT infrastructure.

Required Skills/Experience (MANDATORY)

• Individual proposed must have verifiable working experience in the following;
• 8 years experience Department of Transportation oversize and overweight permitting rules, regulations, procedures, and with current oversize and overweight vehicle permitting and routing technologies.
• 8 years experience Commercial vehicle rules, regulations, registration, permitting, and enforcement processes.
• 8 years experience with architecture and implementation of CVIEW data exchange and ITD/CVISN Level 1 Compliance

Preferred/Not Required

• Implementation and management of IT projects within the government sector including specific experience working with state government

Cleo Consulting is an equal opportunity employer (Minorities/Women/Veterans/Disabled)