跳到正文
Jones Ray

ScholarPulse 日报 2026-08-08

2026-08-08 学术简报:2 篇。合成临床基准的真实度需在效用约束下显式优化,而非仅依赖效用检查作为真实度充分证据,尤其在医疗隐私敏感场景中。

今日速览

序号标题来源日期主题推荐等级
1Improving the Realism of Synthetic Clinical Benchmarks Under Utility ConstraintsarXiv2026-08-06AI-Agent高
2EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement LearningarXiv2026-08-06AI-Agent高

重点论文与技术动态

1. Improving the Realism of Synthetic Clinical Benchmarks Under Utility Constraints

一句话结论

合成临床基准的真实度需在效用约束下显式优化,而非仅依赖效用检查作为真实度充分证据,尤其在医疗隐私敏感场景中。

核心内容

方法与数据

价值判断

摘要 Synthetic clinical benchmarks for enterprise AI agents can pass existing utility checks and still remain structurally unrealistic, especially in privacy-sensitive healthcare settings where operational data are hard to access. We study how to improve such benchmarks without breaking the downstream utility checks already used in practice. We formulate benchmark revision as utility-constrained realism improvement: dataset changes should increase realism while staying above an operational utility floor. We instantiate this idea on a care-gap benchmark derived from Synthea-generated patients exercised through demonstration electronic health record workflows and then processed by the same downstream pipeline as operational data. Realism is measured through missingness structure, simplicity, structural plausibility, and population alignment. The baseline benchmark is extremely thin: sampled-pair missingness is 79.44%, only 12.75% of rows are actionable, 38.94% of patients have zero actionable measures, and top-three token concentration reaches 100.0%. Two deterministic revisions improve these panels while remaining above the current utility floor, whereas a naive densification control preserves unrealistic templating. We further show that internal benchmark realism and source fidelity to an aggregate operational reference are related but distinct objectives. These results suggest that synthetic benchmark quality should be optimized explicitly, with utility treated as one constraint rather than as sufficient evidence of realism.

2. EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning

一句话结论

EnvACE通过世界回放机制实现了无需外部环境交互的LLM智能体训练。

核心内容

该方法在训练中交替执行动作生成与环境响应回放,内部化动作与环境响应的动态关系,形成世界模型直接支持决策,在BFCL-v4等基准测试中显著优于环境扩展基线。

方法与数据

价值判断

摘要 Training large language model agents for long-horizon tool use typically relies on interactions with real or synthesized executable environments, whose construction and verification are costly, or on external simulators that are difficult to ground. We introduce EnvACE, an agentic reinforcement learning method that replaces external environment interaction during training with world rehearsal. The policy alternates between acting and rehearsal: it first generates a tool call, then plays the role of the environment to produce the response induced by that action, and conditions subsequent decisions on the rehearsed response. Both roles are jointly optimized end-to-end using task-success rewards. Through world rehearsal, the policy internalizes the relationship between actions and their environment responses in its parameters, yielding an agent world model that directly supports decision making. Across BFCL-v4, tau^2-Bench, VitaBench, and FinMCP-Bench, EnvACE achieves strong and transferable performance, outperforming environment-scaling baselines in the overall evaluation. Controlled studies further show that world rehearsal consistently improves policy learning across model scales. At test time, the internalized world model enables private rehearsal before committed execution, yielding further gains under a moderate rehearsal budget without additional external interaction. Our findings establish world rehearsal as a new path toward scaling LLM agent training beyond the constraints of external environments. Our code is publicly available at https://github.com/Within-yao/EnvACE.