跳到正文
Jones Ray

ScholarPulse 日报 2026-07-26

2026-07-26 学术简报:2 篇。本地部署的开源大语言模型在纵向研究数据准备任务中表现优异,平均任务完成率达87.9%,为治理受限研究提供可行路径。

今日速览

序号标题来源日期主题推荐等级
1Agentic coding without the cloud: evaluating open-weight large language models on longitudinal data preparation tasksarXiv2026-07-23RAG高
2PATS: Policy-Aware Training Scaffolding for Agentic Reinforcement LearningarXiv2026-07-23AI-Agent高

重点论文与技术动态

1. Agentic coding without the cloud: evaluating open-weight large language models on longitudinal data preparation tasks

一句话结论

本地部署的开源大语言模型在纵向研究数据准备任务中表现优异,平均任务完成率达87.9%,为治理受限研究提供可行路径。

核心内容

方法与数据

价值判断

摘要 Large language models (LLMs) and agents are now widely used tools in code development, with data typically sent to third-party cloud-based models. Their adoption in research using personal data is constrained by governance requirements that typically prohibit data transmission to external services. Locally deployable open-weight models offer an alternative since sensitive data never leave the local environment. We introduce an open-source framework for evaluating the efficacy of AI agents powered by open-weight LLMs on one of the most persistent bottlenecks in research on longitudinal population studies: data preparation. The framework comprises: a curated ground-truth dataset (cleaning scripts preparing six sweeps of data from a British cohort study), task definitions encompassing tasks such as category harmonization and multi-wave merging, and automated routines for evaluating the LLM-produced R code and outputted data. We benchmark LLMs across the (consumer grade) deployment spectrum to assess their efficacy in 20 data preparation tasks (creation of 102 variables). Current state-of-the-art, 31-35B parameter models almost saturated our benchmark ("average task completion" up to 87.9%). The performance of open-weight LLMs running on consumer-grade hardware shows promise of a viable path toward AI-assisted data preparation in governance-restricted research settings. Our framework is publicly available at: https://github.com/UCL-ARC/RRBench.

2. PATS: Policy-Aware Training Scaffolding for Agentic Reinforcement Learning

一句话结论

PATS通过政策感知动态训练脚手架显著提升了长时域LLM代理强化学习的性能。

核心内容

方法与数据

价值判断

摘要 In long-horizon LLM agent reinforcement learning, weak policies often repeat similar failures, producing uninformative rollout trajectories and limiting effective policy optimization. Existing skill-centric methods improve exploration by optimizing, filtering, or internalizing reusable skills. However, they remain centered on the skills themselves rather than being designed as adaptive training-time support for the evolving policy. To address this, we propose a policy-centric training paradigm that reframes skills as a dynamic training scaffold. Our framework, Pats, converts rollout groups from the latest policy into evidence cards and uses task-specific evaluation to adjust the context used in subsequent rollouts. Concrete guidance helps weak policies to complete challenging tasks. As policy improves, redundant context is revised or removed to reduce reliance on explicit guidance while preserving useful rollout variation. The policy is optimized with environmental rewards using standard RLVR, and the training scaffold is discarded at deployment. On ALFWorld and WebShop, Pats improves over strong baselines by up to 18.6%. Across seven search-augmented QA benchmarks, it remains competitive while using 32.1% fewer prompt tokens than the baseline.