跳到正文
Jones Ray

ScholarPulse 日报 2026-07-18

2026-07-18 学术简报:2 篇。该研究提出Agent-Client Protocol (ACP)作为统一通信协议,有效解决人机交互层碎片化问题,实现高效实时人机协作。

今日速览

序号标题来源日期主题推荐等级
1Human-Robot Interaction in GenAI Architectures via the Agent-Client ProtocolarXiv2026-07-16MCP高
2SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement LearningarXiv2026-07-16AI-Agent高

重点论文与技术动态

1. Human-Robot Interaction in GenAI Architectures via the Agent-Client Protocol

一句话结论

该研究提出Agent-Client Protocol (ACP)作为统一通信协议,有效解决人机交互层碎片化问题,实现高效实时人机协作。

核心内容

方法与数据

价值判断

摘要 Recent advances in Generative Artificial Intelligence (GenAI), particularly Large Language Models (LLMs), are driving robotic architectures toward agent-based high-level orchestration, in which natural-language instructions can be translated into context-aware action sequences. While the integration of these agents and robotic capabilities is increasingly converging toward standardization through the Model Context Protocol (MCP), the upper Human-Robot Interaction (HRI) layer remains fragmented by proprietary, ad hoc interfaces that hinder real-time human-in-the-loop collaboration. To address this fragmentation, this paper proposes the adoption of the Agent-Client Protocol (ACP) -- a communication standard originally introduced for coding agents in software engineering -- as a unified communication contract for the HRI layer in agent-based robotic systems. By combining ACP at the interface-agent link and MCP at the agent-execution link, we formulate a fully decoupled three-layer architecture that separates human interaction, deliberative orchestration, and physical execution. This topology removes rigid architectural dependencies, enabling heterogeneous user interfaces to connect to the same robotic system and allowing the underlying robotic platform to be replaced without requiring client-specific integration changes. Moreover, it provides native support for collaborative HRI capabilities such as real-time observability, explicit human authorization, and immediate task interruption. We experimentally evaluate the proposed architecture on a physical mobile robot, demonstrating interoperability across three heterogeneous user interfaces and validating real-time human-in-the-loop workflows with negligible latency overhead.

2. SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning

一句话结论

SEED通过自进化框架将完成轨迹转化为训练时hindsight skills,弥合RL中轨迹级奖励与token级策略学习的监督间隙。

一段话。
SEED首先微调策略分析完成轨迹生成自然语言技能(如可重用工作流、关键观察),随后在RL中策略同时收集轨迹并作为分析器提取技能,使监督随策略进化。它重评分动作以生成密集token级蒸馏信号,与结果RL联合优化,实验表明在文本和视觉代理任务上一致提升性能和样本效率。

核心内容

方法与数据

价值判断

摘要 Large language models are increasingly trained as interactive agents for long-horizon tasks involving multi-turn interaction, tool use, and environment feedback. Outcome-based reinforcement learning (RL) provides a practical optimization paradigm, but its sparse trajectory-level rewards offer limited guidance on intermediate decisions, leaving a supervision gap between episode-level outcomes and token-level policy learning. We propose SEED (SElf-Evolving On-Policy Distillation), a self-evolving framework that converts completed on-policy trajectories into training-time hindsight skills and distills their behavioral effect back into the policy model. SEED first fine-tunes the policy to analyze completed trajectories and generate natural-language skills that capture reusable workflows, decisive observations, or failure-avoidance rules. During RL, the current policy both collects trajectories and serves as the analyzer that extracts hindsight skills from them. Policy updates therefore improve subsequent decision making and skill analysis together, allowing hindsight supervision to evolve with the policy. SEED then re-scores the sampled actions under ordinary and skill-augmented contexts, converting the skill-induced probability shift into a dense token-level on-policy distillation signal. This signal is jointly optimized with outcome-based RL, keeping the auxiliary supervision aligned with the current trajectory distribution. Extensive experiments on text-based and vision-based agentic tasks show that SEED consistently improves performance and sample efficiency, exhibiting robust generalization to unseen scenarios. Our code is available at https://github.com/jinyangwu/SEED.