跳到正文
Jones Ray

ScholarPulse 日报 2026-08-28

2026-08-28 学术简报:2 篇。WikiSkill通过持久知识库系统积累agent经验,显著提升技能进化效果。

今日速览

序号标题来源日期主题推荐等级
1WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill EvolutionarXiv2026-08-27AI-Agent高
2Do User-Authored Permission Policies Improve Protection Against AI Agent Overreach?arXiv2026-08-27AI-Agent高

重点论文与技术动态

1. WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

一句话结论

WikiSkill通过持久知识库系统积累agent经验,显著提升技能进化效果。

该框架在多样基准测试中验证了系统性积累agent经验对开发可重用和可迁移技能的益处,同时ablation studies确认wiki知识积累对技能进化至关重要。

核心内容

方法与数据

价值判断

摘要 Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.

2. Do User-Authored Permission Policies Improve Protection Against AI Agent Overreach?

一句话结论

用户自定义权限策略未能有效提升对AI代理越权行为的防护,反而在阻止越权方面效果较差。

核心内容

方法与数据

价值判断

摘要 AI agents are poised to become a primary interface to digital products, acting across email, files, payments, and personal data. People without professional software backgrounds need understandable, reusable ways to control actions across services. We examine a mechanism in which a language model maps actions to plain-language consequence categories with user-authored "allow", "ask", or "never" rules. We ask what is gained and lost when decisions are made in advance as reusable rules rather than separately for each action. We analyzed 113 participants without professional software backgrounds across three conditions: per-action human-in-the-loop approval (HITL), automated per-action model review (AUTO), or user-authored consequence policy (POLICY). Participants judged 2 examples in each of 4 consequence categories; POLICY participants then set one rule per category. All supervised an 18-action simulated day, including 7 overreach actions. POLICY blocked less overreach than HITL (-20.1 percentage points, 95% CI [-32.1, -8.1]) and AUTO (-14.5 points, 95% CI [-25.8, -3.2]). POLICY lowered runtime prompts from 18.0 to 10.9, but total intervention time was not reliably lower when rule setup was included. Exploratory analysis showed that participants chose "ask" for 114 of 140 POLICY rules, returning most overreach actions to runtime. Of the 148 overreach actions executed in POLICY, 133 followed human approval and 15 ran automatically under "allow" rules. Across all 7 overreach actions, POLICY had the highest approval rate. Counterintuitively, user-authored rules did not by themselves provide stronger protection: many actions outside users' original requests went through after users approved them. These results reveal a gap between preference and commitment: repeatedly choosing "ask" preserves case-by-case choice but prevents a standing policy from settling decisions in advance.