Associate Data Engineer

Job Description

The Office of Technology and Innovation (OTI) leverages technology to drive opportunity, improve public safety, and help government run better across New York City. From delivering affordable broadband to protecting against cybersecurity threats and building digital government services, OTI is at the forefront of how the City delivers for New Yorkers in the 21st century. Watch our welcome video to see our work in action, follow us on social media @NYCOfficeofTech, and visit oti.nyc.gov to learn more.

At OTI, we offer great benefits, and the chance to work on projects that have a meaningful impact on millions of people. You'll have the opportunity to work with cutting-edge technology and collaborate with other passionate professionals who share your drive and commitment to making a difference through technology.

About New York City Cyber Command OTI / NYC Cyber Command is charged with protecting all City systems against cyber threats, including systems that deliver vital services to New Yorkers. Headed by the Chief Information Security Officer of the City of New York, we provide in-depth support to over 100 agencies and offices to protect, detect, identify, respond to, and recover from cyber threats. The Security Sciences teams provide highly functional, available, trusted solutions that enable the city government to prevent, detect, respond, and recover from cyber threats.

Security Sciences is responsible for security, architecture and engineering, with an emphasis on big data and emerging technology. This includes evaluating security tools, building a highly resilient and defensible security architecture, and supporting Cyber Command's software engineering and development lifecycle in order to rapidly meet the mission needs.

About the Position
We are seeking a motivated Associate Data Engineer to join our Data Science Team. Our Data Science Team strives to make security data a strategic asset by providing a platform to structure, manage, integrate, control, analyze, and support threat management activities. As an Associate Data Engineer, you will help build a secure, scalable, and cloud native data processing framework that will support OTI / Cyber Command's cybersecurity mission.

Responsibilities will include:
- Develop and maintain our data pipeline using Apache Beam, Java, Python, and other data processing technologies;
- Identify and implement performance improvements across all pipelines;
- Engage with data consumers and producers to design appropriate models to suit all needs;
- Maintain information exchanges through publish, subscribe, and alert functions that enable users to send and receive critical information as required;
- Support incident management, service-level management, change management, release management, continuity management, and availability management for databases and data management systems;
- Administer databases and/or data management systems that allow for the secure storage, query, protection, and utilization of data;
- Handle special projects and initiatives as assigned.

HOURS/SHIFT
Day - Due to the necessary technical duties of this position in a 24/7 operation, candidate may be required to work various shifts such as weekends and/or nights/evenings.

WORK LOCATION
Brooklyn, NY

TO APPLY
* Interested applicants with other civil service titles who meet the preferred requirements should also submit a resume for consideration

Please go to www.cityjobs/jobs/search and search for Job ID #768713

SUBMISSION OF A RESUME IS NOT A GUARANTEE THAT YOU WILL RECEIVE AN INTERVIEW
APPOINTMENTS ARE SUBJECT TO OVERSIGHT APPROVAL

OTI participates in E-Verify

#LI-DNI

IT SECURITY SPECIALIST - 95622

Minimum Qualifications

A baccalaureate degree from an accredited college and four years of satisfactory full-time experience related to projects and policies required by the particular position; or,

Education and/or experience which is equivalent to "1" above.

Preferred Skills

The preferred candidate should possess the following: - Experience with Agile Development Methodology - Practical knowledge of both Java and Python - Familiarity with Unix scripting, Web development, and automated testing - Familiarity with machine learning techniques and machine learning toolkits such as R, scikit-learn, etc. - Experience working with Terraform. - Familiarity with the CI/CD process At least one year professional, academic, or personal experience with software development or data engineering experience (includes internship experience). - At least 1 year professional, academic, or personal experience with object-oriented/object function scripting languages preferably java or python. - Familiarity with or exposure to cloud application development. - Familiarity with distributed data processing frameworks.

Public Service Loan Forgiveness

As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education's website at ;br>
Residency Requirement

New York City Residency is not required for this position

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.