As these artificial intelligence (AI) bots rapidly become part of everyday life, basic safety disclosure is “dangerously lagging,” a new report found.

A research team led by the University of Cambridge found AI developers share plenty of data on what these agents can do, while withholding evidence of the safety practices needed to assess any risks posed by AI.

The AI Agent Index, a project that includes researchers from MIT, Stanford and the Hebrew University of Jerusalem, investigated the abilities, transparency and safety of thirty “state of the art” AI agents, based on public information and correspondence with developers.

Leon Staufer, a researcher studying for an MPhil at Cambridge’s Leverhulme Centre for the Future of Intelligence led the latest update of the Index. Researchers looked at available data for a range of leading chat, browser and workflow AI bots built mainly in the U.S. and China.

The team found a “significant transparency gap.” Developers of just four AI bots in the Index publish agent-specific “system cards:” Formal safety and evaluation documents that cover everything from autonomy levels and behavior to real-world risk analyses.*

Schneider Bold
Don’t Disclose Safety Results

Additionally, 25 out of 30 AI agents in the Index do not disclose internal safety results, while 23 out of 30 agents provide no data from third-party testing, despite these being the empirical evidence needed to rigorously assess risk.

Known security incidents or concerns have only been published for five AI agents, while “prompt injection vulnerabilities” – when malicious instructions manipulate the agent into ignoring safeguards – ended up documented for two of those agents.
Of the five Chinese AI agents analyzed for the Index, only one had published any safety frameworks or compliance standards of any kind.

“Many developers tick the AI safety box by focusing on the large language model underneath, while providing little or no disclosure about the safety of the agents built on top,” Staufer said.

“Behaviors that are critical to AI safety emerge from the planning, tools, memory, and policies of the agent itself, not just the underlying model, and very few developers share these evaluations.”

In fact, the researchers identify 13 AI agents that exhibit “frontier levels” of autonomy, yet only four of these disclose any safety evaluations of the bot itself.

“Developers publish broad, top-level safety and ethics frameworks that sound reassuring, but are publishing limited empirical evidence needed to actually understand the risks,” Staufer said.

“Developers are much more forthcoming about the capabilities of their AI agent,” he said. “This transparency asymmetry suggests a weaker form of safety washing.”

The latest annual update provides verified information across 1,350 fields for the thirty prominent AI bots, as available up to the last day of 2025.

Index Criteria

Criteria for featuring in the Index included public availability and ease of use, and developers with a market valuation of over $1 billion. Some 80 percent of the Index bots ended up released or had major updates in the last two years.

The Index update shows that – outside of Chinese AI bots – almost all agents depend on a few foundation models (GPT, Claude, Gemini), a significant concentration of platform power behind the AI revolution, as well as potential systemic choke points.

“This shared dependency creates potential single points of failure,” said Staufer. “A pricing change, service outage, or safety regression in one model could cascade across hundreds of AI agents. It also creates opportunities for safety evaluations and monitoring.”

Many of the least transparent agents are AI-enhanced web browsers designed to carry out tasks on the open web on a user’s behalf: Clicking, scrolling, and filling in forms for tasks ranging from buying limited-release tickets to monitoring eBay bids.

Browser agents have the highest rate of missing safety information: 64 percent of safety-related fields unreported. They also operate at the highest levels of autonomy.

This is closely followed by enterprise agents, business management AI aimed at reliably automating work tasks, with 63 percent of safety-related fields missing. Chat agents are missing 43 percent of safety-related fields in the Index.

Staufer points out there are no established standards for how AI agents should behave on the web. Moreover, most agents do not disclose their AI nature to end users or third parties by default. Furthermore, only three agents support watermarking of generated media to identify it as from AI.

Mimic Human Browsing

At least six AI agents in the Index explicitly use types of code and IP addresses designed to mimic human browsing behavior and bypass anti-bot protections.

“Website operators can no longer distinguish between a human visitor, a legitimate agent, and a bot scraping content,” said Staufer. “This has significant implications for everything from online shopping and form-filling to booking services and content scraping.”

“The latest AI Agent Index reveals the widening gap between the pace of deployment and the pace of safety evaluation,” Staufer said. “Most developers share little information about safety, evaluations, and societal impacts.

“AI agents are getting more autonomous and more capable of acting in the real world, but the transparency and governance frameworks needed to manage that shift are dangerously lagging,” he said.

Click here for more on the report.

Pin It on Pinterest

Share This