跳到正文
Jones Ray

ScholarPulse 日报 2026-06-20

2026-06-20 学术简报:2 篇。当大型语言模型作为多智能体系统评估者时,其评估偏差会通过代理网络传播,Contagion Networks框架有效量化了这一传播过程。

今日速览

序号标题来源日期主题推荐等级
1Contagion Networks: Evaluator Bias Propagation in Multi-Agent LLM SystemsarXiv2026-06-18AI-Agent高
2LLM agent safety, multi-turn red-teaming, jailbreak benchmarks, adversarial robustness, safety-critical systemsarXiv2026-06-18AI-Agent高

重点论文与技术动态

1. Contagion Networks: Evaluator Bias Propagation in Multi-Agent LLM Systems

一句话结论

当大型语言模型作为多智能体系统评估者时,其评估偏差会通过代理网络传播,Contagion Networks框架有效量化了这一传播过程。

核心内容

方法与数据

价值判断

摘要 When large language models serve as evaluators in multi-agent systems, their systematic evaluation biases propagate through the agent network. We introduce Contagion Networks, a formal framework for measuring how evaluator biases spread across interacting LLM agents. In a controlled 3-agent experiment using DeepSeek-chat with three distinct evaluator bias profiles (structured, balanced, evidence-based), we measure the Cross-Agent Contagion Matrix Gamma_3 and find that evaluator biases consistently propagate between agents (gamma in [0.157, 0.352]), even within the same underlying model. We identify three propagation regimes governed by the spectral radius rho(Gamma_N), and demonstrate that homogeneous-model agents produce contagion coefficients 3-5x weaker than cross-model coefficients observed in prior work (MM-EPC: gamma approx 0.85-1.3), placing them in the suppression regime. We show that increasing evaluator committee size from k=1 to k=3 reduces effective contagion by 72.4%, providing an actionable mitigation strategy. We release the open-source Contagion Network experimental framework.

2. LLM agent safety, multi-turn red-teaming, jailbreak benchmarks, adversarial robustness, safety-critical systems

一句话结论

自适应多轮攻击可靠地导致LLM代理操作的安全关键系统失去关键安全功能,成功率在8.7%至12.1%之间。

核心内容

方法与数据

价值判断

摘要 Large language model (LLM) agents are increasingly proposed as supervisory components for safety-critical systems, yet their robustness under sustained, adaptive adversarial pressure remains poorly characterized. We present NRT-Bench, a benchmark for multi-turn red-teaming of LLM agents acting as operators of a safety-critical system, instantiated in a simulated nuclear power plant control room. A five-role operator team, each backed by a configurable LLM, runs a plant governed by six critical safety functions (CSFs), while adversaries inject messages over four channels in bounded multi-turn sessions with per-turn feedback. Harm is an objective signal rather than LLM-judged text: a run terminates the moment any CSF is lost, attributed to the causing message. Evaluating four frontier operator models under a fixed-attack paired-replay protocol, we find that adaptive multi-turn attacks reliably push the operator team past a safety limit: across the four models, between 8.7% and 12.1% of attack sessions end with the plant losing a critical safety function. Although the four models look almost equally robust by this aggregate rate, their failures barely overlap: of $149$ sessions, none defeat all four models while a third defeat at least one, so vulnerabilities are nearly disjoint across models rather than nested. The effect of added defences is strongly model-dependent: the same guardrail stack or safety-advisor agent that lowers attack success for one model can raise it for another. We release the simulation venue, attack dataset, and replay tooling for reproducible safety evaluation of LLM agents.