跳到正文
Jones Ray

ScholarPulse 日报 2026-06-29

2026-06-29 学术简报:2 篇。ToolPrivacyBench正式定义了最小必要披露边界。

今日速览

序号标题来源日期主题推荐等级
1ToolPrivacyBench: Benchmarking Purpose-Bound Privacy in Tool-Using LLM AgentsarXiv2026-06-26AI-Agent高
2From Detection to Action: Using LLM Agents for Fault-Tolerant ControlarXiv2026-06-26RAG高

重点论文与技术动态

1. ToolPrivacyBench: Benchmarking Purpose-Bound Privacy in Tool-Using LLM Agents

一句话结论

ToolPrivacyBench正式定义了最小必要披露边界。

一段话:该基准通过轨迹级审计评估工具使用中的隐私过披露,基于2,150个案例的实验发现,任务成功执行并不等同于隐私披露适当,代理可能在中间工具调用中传输不必要的私有信息。

核心内容

方法与数据

价值判断

摘要 Large language models (LLMs) have increasingly moved from standalone text generation systems to agents that invoke external tools, access environments, and execute multi-step tasks. However, conventional function-calling benchmarks mainly evaluate task completion and API correctness, while privacy evaluation benchmarks typically focus on final responses or privacy judgments. Neither perspective captures purpose-bound information flow across an executed multi-tool trajectory. Motivated by this limitation in current agent evaluation, ToolPrivacyBench audits whether task-private atoms are routed only to authorized tools and downstream sinks, thereby evaluating both task completion and privacy over-disclosure during tool use. The benchmark contains 2,150 cases, including 1,150 fully synthetic privacy-sensitive business workflows and 1,000 cases adapted from existing multi-tool and function-calling benchmarks. Each case is represented by a policy knowledge base. After an agent executes against mock business backends, the evaluator compares recorded tool arguments and backend audit logs with this policy knowledge base. The evaluation covers nine widely used agents to characterize purpose-bound privacy over-disclosure. The results show that successful tool execution does not imply appropriate privacy disclosure: an agent may complete a task while transmitting unnecessary private information through intermediate tool calls. ToolPrivacyBench therefore formalizes a need-to-know disclosure boundary, under which each tool should receive only the information necessary for its stated purpose, and uses trajectory-level auditing to identify privacy over-disclosure in multi-tool workflows.

2. From Detection to Action: Using LLM Agents for Fault-Tolerant Control

一句话结论

该框架通过LLM代理实现故障检测到约束感知恢复动作的自动化,证明在离散和连续过程中使用轻量级模型能高效生成有效决策。

核心内容

方法与数据

价值判断

摘要 We propose an agentic Large Language Model (LLM) framework for active Fault-Tolerant Control (FTC) that transforms fault detection outputs into constraint-aware recovery actions grounded in plant-specific knowledge. The approach couples (i) a multi-agent workflow that decomposes operator duties into monitoring, planning, action synthesis, simulation, validation, and reprompting; (ii) a Digital Process Plant Twin (DPPT) that exposes plant data, models, and a simulation service for pre-execution testing; and (iii) a Graph Retrieval-Augmented Generation (Graph RAG) layer built on the CPSMod ontology, which organizes plant knowledge (structure, function, hybrid dynamics, control context, and fault semantics) into a graph that supports relation-aware, multi-hop retrieval for the agents. Corrective actions are generated as minimal-risk state-machine recovery paths and corresponding discrete commands or continuous setpoint adaptations, then validated deterministically against interlocks, envelopes, and dynamic feasibility before any actuation. If no acceptable plan is found within a bounded time window, control is handed to a safety fallback. The framework is evaluated in simulation on two representative benchmarks: a discrete batch Mixing Module and a Continuous Stirred-Tank Reactor (CSTR) under closed-loop PID regulation. Results with lightweight LLMs (GPT-4o-mini and GPT-4.1-mini) show that semantically grounded agents can derive valid recovery decisions within latency budgets compatible with the respective process dynamics, demonstrating a practical pathway from detection to validated corrective action across both discrete and continuous FTC tasks.