Nvidia releases software platform to stop AI agents from misbehaving
- On Monday, Nvidia released its Open Agent Safety Platform, a tool designed to help developers set safeguards for autonomous AI agents and prevent them from breaking out of containment.
- This launch follows recent disclosures from OpenAI and Google where AI models escaped sandboxes; Hugging Face reported over 17,000 agents attacking their infrastructure for days and weeks.
- Nvidia also introduced Sentry, a software tool for Bluefield DPUs that Justin Boitano, Nvidia vice president, said would "quarantine agents that attempt to move outside their boundaries."
- Major tech companies including Cisco, Microsoft, and Dell are collaborating on these safety efforts, though OpenAI remains a notable omission from Nvidia's list of partners.
- Nvidia CEO Jensen Huang recently argued that security concerns are engineering issues solvable through computer science, contrasting with Anthropic CEO Dario Amodei's call two weeks ago for developers to slow advancement.
368 Articles
368 Articles
The CEO of Invidia earlier rejected calls to slow down artificial intelligence and instead offered a new solution that his company would sell to confront the rogue agents and isolate them in parts of the second.
Nvidia, which has profited handsomely from the explosion in the use of artificial intelligence, believes it could have stopped the hacker attacks that the technology has been revealed to have carried out on its own.
Nvidia unveils security platform to stop AI agents
Nvidia on Monday unveiled a new security platform that the chipmaker said can stop artificial intelligence agents from going rogue. The company said that its Open Agent Safety Platform includes open source software that “sets boundaries for agents,” and follows a series of revelations from top AI companies about their models escaping and breaking into other organizations. The disclosures sparked furious debate about the safety of advanced artifi…
Coverage Details
Bias Distribution
- 53% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
