Microsoft, Nvidia push provenance checks as open-weight AI adoption accelerates

Microsoft and Nvidia are urging enterprises to assess the security of open-weight AI models throughout deployment, warning that changes to model weights and configurations can weaken safeguards even when a model retains its ability to perform assigned tasks.
Microsoft and Nvidia are urging enterprises to assess the security of open-weight AI models throughout deployment, warning that changes to model weights and configurations can weaken safeguards even when a model retains its ability to perform assigned tasks.
In a joint paper published last week, the companies identified 30 risk types across five categories and outlined a process for evaluating, mitigating, and monitoring them. The guidance calls for enterprises to verify model provenance, test the configurations they intend to deploy, and reassess risks after material changes.
“Weight openness alone does not determine an AI system’s risk,” the paper said . “Risk depends on the model, use case, deployment, and safeguards.”
The framework covers cybersecurity, data protection, content, human-AI interaction, and bias. Its cybersecurity category includes malicious code generation, malicious tool calls, extraction of the model’s safety policies, excessive token generation, and behavior that diverges from the intended system goal.
The paper draws on existing NIST and ISO risk-management standards and is the first in a planned series on managing risks across open-weight AI deployments, the companies said in a blog post.
Source: CSO Online. This article summarizes the linked reporting; figures and quotes are attributed to the original source.