跳到正文
Jones Ray

ScholarPulse 日报 2026-06-17

2026-06-17 学术简报:2 篇。LLM代理无需执行代码即可识别90%的论文-仓库对中的实际可复现性问题。

今日速览

序号标题来源日期主题推荐等级
1ReproRepo: Scaling Reproducibility Audits with GitHub Repository IssuesarXiv2026-06-16AI-Agent高
2Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid StructurearXiv2026-06-16AI-Agent高

重点论文与技术动态

1. ReproRepo: Scaling Reproducibility Audits with GitHub Repository Issues

一句话结论

LLM代理无需执行代码即可识别90%的论文-仓库对中的实际可复现性问题。

核心内容

方法与数据

价值判断

摘要 Reproducing research results from papers and released code is central to scientific progress. Existing works have introduced benchmarks to evaluate whether LLM agents can assist with reproducibility, but they are difficult to scale due to their reliance on substantial manual effort for data curation and evaluation. We introduce ReproRepo, a scalable framework for reproducibility evaluation that leverages human-raised GitHub issues as naturally occurring supervision on realistic reproduction blockers. We instantiate ReproRepo on 1,149 recent machine learning papers from major conferences and evaluate four frontier model-agent configurations. Our results show that LLM agents, even without executing code, can identify many real-world reproducibility problems from paper-repository pairs: the best agent in our study, namely Codex with GPT-5.5, surfaces at least one semantically related human-reported blocker for ~90% of papers in the study. Further analysis shows that agents are particularly effective for surfacing visible failures and identifying the right semantic region, but may still be insufficient in exact localization. ReproRepo can serve as a reusable, scalable framework for future evaluations of LLM agents on real-world reproducibility auditing. Our code is released at https://github.com/LithiumDA/ReproRepo.

2. Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structure

一句话结论

LEADS框架通过LLM代理自动发现混合模型结构,显著提升心脏电生理数字孪生的稳定性和可解释性,优于人类设计和现有LLM方法。

核心内容

方法与数据

价值判断

摘要 Building personalized cardiac electrophysiology (EP) digital twins requires identifying the appropriate model structure for each patient, not merely fitting parameters. Traditional methods rely on experts to manually prescribe hybrid physics-neural architectures, which requires deep domain expertise and does not transfer across patients. Recent works have applied large language models (LLMs) to generate or act as hybrid models. However, despite their promising generalization capacity, these LLM-based methods lack the structural priors needed for stable cardiac simulations. Hence, we propose LEADS, a framework that formulates cardiac EP domain knowledge as a structured action space and utilizes an LLM agent to discover hybrid models. The agent follows an iterative reasoning-and-action loop to select, combine, and refine hybrid models, whilst gradient descent handles parameter fitting. The proposed LEADS designs every candidate model towards physically grounded, interpretable, and numerically stable, while allowing open-ended architectural discovery. We validate LEADS on synthetic data with three ground-truth reaction models and on real cardiac EP data, demonstrating that it outperforms both human-designed hybrid models and other LLM-based hybrid modeling.