Big Data Architect

Position Description: This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications. This is an exciting opportunity to work as a part of a collaborative senior data team supporting DC's Chief Data Officer. This architecture includes Databricks, Microsoft Azure platform tools (including Data Lake and Synapse), Apache platform tools (including Hadoop, Hive, Impala, Spark, Sedona, and Airflow), and data pipeline/ETL development tools (including Streamsets, Apache NiFi, Azure Data Factory). The platform will be designed for District-wide use and integration with other OCTO Enterprise Data tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle databases and integration tools.

Position Responsibilities:

• Coordinates IT project management, engineering, maintenance, QA, and risk management.
• Plans, coordinates, and monitors project activities.
• Develops technical applications to support users.
• Develops, implements, maintains, and enforces documented standards and procedures for the design, development, installation, modification, and documentation of assigned systems.
• Provides training for system products and procedures.
• Performs application upgrades.
• Performs monitoring, maintenance, or reporting on real-time databases, real-time network and serial data communications, and real-time graphics and logic applications.
• Troubleshoots problems.
• Ensures project life-cycle follows District standards and procedures.