A Survey of Safety in Self-Evolving Agents Explores Reusable State and the SAVER Framework
A research paper on arXiv proposes the SAVER framework to address safety concerns in self-evolving agents that update model parameters, memories, and workflows dynamically. The study highlights how locally safe experiences can become hazardous when they persist and gain broader authority across contexts.
Traditional large language model deployments rely on static weights and configurations, but emerging self-evolving agents continuously update their internal states, tool definitions, and workflows based on user feedback and environmental data. This continuous adaptation presents a novel safety challenge. Information that is completely benign in an isolated context can cause persistent vulnerabilities once integrated into the agent's reusable memory or base parameters.
Primary source
Open arXiv ↗This article summarizes the source. Check the original for full details and conditions.
Comparison
| Aspect | Before / Alternative | After / This |
|---|---|---|
| State Management | Static model parameters and fixed system prompts after deployment. | Dynamically updated reusable states, tool definitions, and workflows. |
| Safety Boundary | Evaluating local inputs and immediate output alignment. | Assessing safety across state accumulation and cross-context reuse. |
| Risk Vectors | Immediate jailbreaks, malicious prompts, and training data poisoning. | Legitimate state transitions that expand in scope, authority, and persistence. |
| Mitigation Focus | In-context filtering, input sanitization, and static RLHF. | Continuous state tracking, descendant repair, and dynamic revocation. |
