The National Institute of Standards and Technology (NIST) released three final guidance documents first released in April for public comment, as well as a draft guidance document from the U.S. AI Safety Institute intended to help mitigate risks.
NIST also released a software package designed to measure how adversarial attacks can degrade the performance of an AI system. In addition, the Department of Commerce’s U.S. Patent and Trademark Office (USPTO) issued a guidance update on patent subject matter eligibility to address innovation in critical and emerging technologies, including AI.
“For all its potentially transformational benefits, generative AI also brings risks that are significantly different from those we see with traditional software. These guidance documents and testing platform will inform software creators about these unique risks and help them develop ways to mitigate those risks while supporting innovation,” said Laurie E. Locascio, under secretary of commerce for standards and technology and NIST Director.
The NIST released two new AI technology offerings.
One is the initial public draft of a guidance document from the U.S. AI Safety Institute, intended to help software developers mitigate the risks stemming from generative AI and dual-use foundation models. Another guidance is a testing platform designed to help AI system users and developers measure how certain types of attacks can degrade the performance of an AI system.
NIST also released final version of three other projects, two of which are guidance documents designed to help manage the risks of generative AI – the technology that enables many chatbots as well as text-based image and video creation tools – and serve as companion resources to NIST’s AI Risk Management Framework (AI RMF) and Secure Software Development Framework (SSDF).
The third release is a plan for U.S. stakeholders to work with others around the globe on AI standards. These three publications previously appeared April 29 in draft form for public comment, and NIST released their final versions.
The two releases NIST issued are:
- AI foundation models are powerful tools useful across a broad range of tasks and are sometimes called “dual-use” because of their potential for benefit and harm. NIST’s AI Safety Institute released the initial public draft of its guidelines on Managing Misuse Risk for Dual-Use Foundation Models https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.800-1.ipd.pdf, which outlines voluntary best practices for how foundation model developers can protect their systems from being misused to cause deliberate harm to individuals, public safety and national security.The draft guidance offers seven key approaches for mitigating the risks that models will end up misused. It also provides recommendations for how to implement them and how to be transparent about their implementation. Together, these practices can help prevent models from enabling harm through activities like developing biological weapons, carrying out offensive cyber operations, and generating child sexual abuse material and nonconsensual intimate imagery.NIST is accepting comments from the public on the draft Managing the Risk of Misuse for Dual-Use Foundation Models until Sept. 9, at 11:59 p.m. Eastern Time. Click here to email comments on the draft.
- One of the vulnerabilities of an AI system is the model at its core. By exposing a model to large amounts of training data, it learns to make decisions. But if adversaries poison the training data with inaccuracies, the model can make incorrect, potentially disastrous decisions. Testing the effects of adversarial attacks on machine learning models is one of the goals of Dioptra, a new software package aimed at helping AI developers and customers determine how well their AI software stands up to a variety of adversarial attacks.
The open-source software, available for free download, could help the community, including government agencies and small to medium-sized businesses, conduct evaluations to assess AI developers’ claims about their systems’ performance.
This software responds to Executive Order section 4.1 (ii) (B), which requires NIST to help with model testing. Dioptra does this by allowing a user to determine what sorts of attacks would make the model perform less effectively and quantifying the performance reduction so that the user can learn how

