跳到正文
Jones Ray

ScholarPulse 日报 2026-07-08

2026-07-08 学术简报:2 篇。该研究通过隐藏状态探针实现LLM代理任务的早期失败预测,显著减少计算资源浪费。

今日速览

序号标题来源日期主题推荐等级
1Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe CascadearXiv2026-07-07AI-Agent高
2AgentTether: Graph-Guided Diagnosis and Runtime Intervention for Reliable LLM Agent OperationarXiv2026-07-07AI-Agent高

重点论文与技术动态

1. Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade

一句话结论

该研究通过隐藏状态探针实现LLM代理任务的早期失败预测,显著减少计算资源浪费。

核心内容

方法与数据

价值判断

摘要 Large language model (LLM) agents solving multi-step tasks frequently commit to trajectories that are doomed to fail, yet continue to consume substantial inference compute before the failure becomes observable. We show that failure is predictable early from the agent's internal representations: lightweight per-round probes on hidden activations anticipate eventual episode failure as early as the first interaction round, where scorers reading only the agent's observable behavior are barely better than chance. We turn this signal into a practical abort cascade: one distribution-free calibrated gate per round, with per-round recall budgets jointly searched so that eventually-successful episodes survive all gates at a user-specified global rate; this episode-level guarantee is the one that matters in deployment, since false-abort risk accumulates across gates. Across two agent models on TextCraft, the cascade meets every recall target from 90% to 97% and, at the 90% target, saves 47.1% +/- 10.3% (Qwen-2.5-7B) and 37.2% +/- 8.8% (Llama-3.2-3B) of inference compute, 1.6--1.7x the best single-gate policy. An otherwise-identical cascade reading only behavior saves roughly half as much, and adding behavioral features to the probe yields no further gain: the hidden states capture what behavior reveals. Finally, we characterize the sample complexity of certifying high recall targets, telling practitioners which recall promises their data can, and provably cannot, back. The code will be released soon.

2. AgentTether: Graph-Guided Diagnosis and Runtime Intervention for Reliable LLM Agent Operation

一句话结论

AgentTether 提出了一种运行时修复框架,能自动诊断LLM代理故障并引导恢复,无需修改底层代理或环境。

核心内容

方法与数据

价值判断

摘要 Large language model (LLM) agents are increasingly used for multi-step, stateful tool-use tasks, yet production reliability remains limited. Unlike static software repair, agent repair must recover dynamic trajectories whose early decisions can propagate into later errors and external state changes. Existing automatic remedies address only part of this problem: blind retry adds no diagnosis, outcome feedback says whether a run failed but not where or why, and self-reflection often lacks grounded evidence to prevent the same failure from recurring. We present AgentTether, a run-time repair framework that automates post-run diagnosis and guided recovery without modifying the underlying agent or environment. AgentTether abstracts each run into Transition Units, links them through a dependency-aware Critical Transition Graph, and localizes failure-critical subtrajectories by combining an offline normal-behavior model with a run-local graph detector. It then converts the localized cause into behavior-scoped guidance backed by cross-iteration Repair Memory, and can optionally apply guarded run-time intervention to keep the correction active during re-execution. The same design can be deployed as an offline diagnostic-and-guidance tool or as an online repair layer. We evaluate AgentTether on 261 tau-bench tasks across three domains with Qwen3.7-max, and test cross-model transfer on Banking with GPT-5.4. On the hardest Banking domain, AgentTether repairs 59.04% (49/83) of initially failed Qwen3.7-max tasks and 65.12% (56/86) of initially failed GPT-5.4 tasks. Overall, AgentTether improves repair effectiveness while reducing agent turns and end-to-end approach tokens, suggesting a practical reliability layer that can wrap existing agent deployments, reduce wasted re-execution, and improve recovery without retraining the agent.