Overview
On Site
Full Time
Skills
Telecommunications
Attention To Detail
Data Science
Data Storage
Big Data
Leadership
Data Analysis
Reporting
Supervision
Apache NiFi
Extract
Transform
Load
Real-time
Data Integration
Management
Snow Flake Schema
Data Warehouse
Performance Tuning
Security Controls
Linux
Microsoft Azure
Amazon Web Services
Google Cloud Platform
Google Cloud
Continuous Integration
Continuous Delivery
Workflow
Collaboration
Analytics
Data Governance
Auditing
Mentorship
Documentation
Data Engineering
Computer Science
Cloud Computing
IT Infrastructure
Recruiting
Job Details
Company Description
Job Description
The IT & Telecom division is seeking a highly skilled, detail-oriented Data Engineer to support the Enterprise Data Science and Engineering Unit (EDSE). EDSE is a specialized team within the Agency dedicated to designing and operating advanced data storage and processing solutions capable of handling very large datasets, or "Big Data." In addition to overseeing Big Data operations, EDSE partners with Agency analysts and data scientists to empower leadership and planners with actionable, data-driven insights for critical projects and strategic initiatives.
The Data Engineer will play a key role in supporting the Department of Sustainable Delivery (DSD), a new division within the NYC Department of Transportation focused on the rapid growth of app-based deliveries and the increasing use of electric micromobility devices such as e-bikes, mopeds, and scooters. DSD brings together data analytics, policy, enforcement, education, and industry oversight to address the unique safety and operational challenges posed by the commercial use of micromobility. By collaborating with DSD, the Data Engineer will help develop and maintain data systems that enable the division to monitor, analyze, and report on micromobility trends, support enforcement and policy initiatives, and ensure that data-driven insights contribute to a safer and more sustainable transportation future for New York City.
Under the direction and supervision of the Director, the Data Engineer will: architect, implement, and maintain scalable data pipelines using Apache NiFi for ETL and real-time data integration; design, optimize, and manage Snowflake data warehouses, including schema design, performance tuning, and security controls; administer Linux-based cloud environments (Azure, AWS, or Google Cloud Platform), including automation of deployments, patching, and monitoring; develop and maintain CI/CD workflows for data engineering solutions; collaborate with data scientists and analysts to deliver high-quality, production-ready datasets and analytics solutions; implement robust data governance, lineage, and auditing practices; troubleshoot and resolve issues across the data platform, including connectivity, performance, and security; mentor Agency staff and contribute to technical best practices and documentation; and perform other data engineering tasks as assigned to support a dynamic and fast-paced team, among other duties.
IT INFRASTRUCTURE ENGINEER - 95714
Qualifications
1. A baccalaureate degree from an accredited college in computer science, engineering or a related field and four years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
2. A baccalaureate degree from an accredited college and eight years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
3. Education and/or experience which is equivalent to "1" or "2" above.
Additional Information
The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.
Job Description
The IT & Telecom division is seeking a highly skilled, detail-oriented Data Engineer to support the Enterprise Data Science and Engineering Unit (EDSE). EDSE is a specialized team within the Agency dedicated to designing and operating advanced data storage and processing solutions capable of handling very large datasets, or "Big Data." In addition to overseeing Big Data operations, EDSE partners with Agency analysts and data scientists to empower leadership and planners with actionable, data-driven insights for critical projects and strategic initiatives.
The Data Engineer will play a key role in supporting the Department of Sustainable Delivery (DSD), a new division within the NYC Department of Transportation focused on the rapid growth of app-based deliveries and the increasing use of electric micromobility devices such as e-bikes, mopeds, and scooters. DSD brings together data analytics, policy, enforcement, education, and industry oversight to address the unique safety and operational challenges posed by the commercial use of micromobility. By collaborating with DSD, the Data Engineer will help develop and maintain data systems that enable the division to monitor, analyze, and report on micromobility trends, support enforcement and policy initiatives, and ensure that data-driven insights contribute to a safer and more sustainable transportation future for New York City.
Under the direction and supervision of the Director, the Data Engineer will: architect, implement, and maintain scalable data pipelines using Apache NiFi for ETL and real-time data integration; design, optimize, and manage Snowflake data warehouses, including schema design, performance tuning, and security controls; administer Linux-based cloud environments (Azure, AWS, or Google Cloud Platform), including automation of deployments, patching, and monitoring; develop and maintain CI/CD workflows for data engineering solutions; collaborate with data scientists and analysts to deliver high-quality, production-ready datasets and analytics solutions; implement robust data governance, lineage, and auditing practices; troubleshoot and resolve issues across the data platform, including connectivity, performance, and security; mentor Agency staff and contribute to technical best practices and documentation; and perform other data engineering tasks as assigned to support a dynamic and fast-paced team, among other duties.
IT INFRASTRUCTURE ENGINEER - 95714
Qualifications
1. A baccalaureate degree from an accredited college in computer science, engineering or a related field and four years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
2. A baccalaureate degree from an accredited college and eight years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
3. Education and/or experience which is equivalent to "1" or "2" above.
Additional Information
The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.