Senior AI Security Engineer

Senior AI Security Engineer Hybrid: 80 Maiden Lane, New York, NY 10038 & Remote (3 days in office/2 days remote) Note: depending on the work objectives, the consultant selected might occasionally need to be in five days a week! For example, they might need to be on site for a full week if we have a testing plan.
12+ Months Long Term Contract
Mandatory Skills:
Candidates who do not have the mandatory skills will not be considered.
Bachelor s degree in computer science, electrical or computer engineering, statistics, econometrics, or related field, or equivalent work experience
12+ years of hands-on experience in cybersecurity or information security.
4+ years of experience programming with demonstrated advanced skills with Python and the standard ML stack (TensorFlow/Torch, NumPy, Pandas, etc.)
4+ years of experience with Natural Language Processing (NLP) and Large Language Models (LLM) desired
4+ years of experience working in cloud environment (Azure, AWS, Google Cloud Platform)
Demonstrated proficiency with AI/ML fundamental concepts and technologies including ML, deep learning, NLP, and computer vision.
Demonstrated ability (expertise preferred) in attacking GenAI products and platforms.
Demonstrated recent experience with large language models.
Ability to stay updated on the latest developments, trends, and best practices in both software testing and artificial intelligence.
Demonstrated experience with using AI testing frameworks and tools such as TensorFlow or PyTorch, or Keras
Demonstrated ability to write test scripts, automate test cases, and analyze test results using programming languages and testing frameworks listed above.
Demonstrated ability to Identify and document defects, irregularities or inconsistencies in AI systems and working closely with developers to rectify and resolve them.
Ability to work independently to learn new technologies, methods, processes,
frameworks/platforms, and systems.
Excellent written and verbal communication skills to articulate challenging technical concepts to both lay and expert audiences
Desired:
Excellent problem-solving and critical thinking skills with attention to detail in an ever-changing environment.
Background in designing and implementing security mitigations and protections and/or publications in the space
Ability to work collaboratively in an interdisciplinary team environment
Participated or currently participating in CTF/GRT/AI Red Teaming events and/or bug bounties developing or contributing to OSS projects.
Understanding of ML lifecycle and MLOps.
Perform various types of tests such as functional testing, regression testing, performance testing, and usability testing to evaluate the behavior and performance of the AI algorithms and models
Ability to ensure the quality, consistency and relevance of data used for training and testing AI models (includes collecting, preprocessing and validating data)
Ability to assess AI systems for ethical considerations and potential biases to make sure they follow ethical standards and encourage inclusivity and diversity
Ability work in and provide technical leadership to cross-functional teams to develop and implement AI/ML solutions, including capabilities that leverage LLM technology
Highly flexible/willing to learn new technologies