跳到正文
Jones Ray

ScholarPulse 日报 2026-08-16

2026-08-16 学术简报:2 篇。SkillShapley框架通过边界自适应Shapley估值,有效量化了LLM代理技能中各步骤的贡献,为技能创建提供关键指导。

今日速览

序号标题来源日期主题推荐等级
1SkillShapley: Boundary-Adaptive Shapley Valuation for Skill Step Attribution in LLM AgentsarXiv2026-08-13AI-Agent高
2Validation-Centric AI-Assisted GPU Porting of a 250,000+ Line Legacy Weather Simulation CodearXiv2026-08-13AI-Agent高

重点论文与技术动态

1. SkillShapley: Boundary-Adaptive Shapley Valuation for Skill Step Attribution in LLM Agents

一句话结论

SkillShapley框架通过边界自适应Shapley估值,有效量化了LLM代理技能中各步骤的贡献,为技能创建提供关键指导。

核心内容

方法与数据

价值判断

摘要 Agent skills are crucial external instructions that enable language agents to execute long procedural tasks such as coding or document processing. Existing agent skills are primarily created through human manual crafting or agent execution traces, with limited understanding of how each step contributes to overall skill performance on specific tasks; i.e., there remains an open problem in quantifying the contribution of individual steps within an agent skill. To address this issue, we first model skill-step attribution as a Shapley value-based contribution estimation problem, and then propose SkillShapley, a step-level attribution framework for agent skills. Notably, SkillShapley operates in two phases, motivated by key empirical insights, i.e., discretized benchmark rewards that create sharp performance cliffs, and step interactions that are largely additive rather than synergistic. Specifically, it first identifies informative coalitional regions, and then adaptively samples new coalitions that can yield reusable marginal evidence. Experiments on skills from the widely adopted SkillsBench demonstrate that our SkillShapley can effectively and efficiently identify high- or low-value skill steps, providing several key takeaways for agent skill creation.

2. Validation-Centric AI-Assisted GPU Porting of a 250,000+ Line Legacy Weather Simulation Code

一句话结论

AI辅助GPU端口化需以验证为中心设计工作流,确保科学有效性不被破坏并实现高效加速。

核心内容

方法与数据

价值判断

摘要 Recent advances in large language models have made CLI-based AI agents a practical tool for accelerating GPU porting of large legacy scientific applications. Such applications, however, are not merely old code bases; they are scientific assets whose credibility has been accumulated through long-term development, comparison with observations, and use in domain studies. GPU porting must therefore preserve this scientific validity while adapting the implementation to GPU-centric HPC systems. This paper presents a validation-centric AI-assisted GPU porting workflow through a case study of CReSS, a legacy Fortran weather simulation code with more than 250,000 lines. The workflow uses an AI agent to extract OpenMP regions, generate dump-based kernel benchmarks from physically meaningful simulation states, apply OpenACC transformations, and validate results through element-wise comparison with dumped reference data and application-level validation. Using a real typhoon simulation, the workflow produced numerically validated GPU implementations for 162 target kernels and achieved a 5.1x application-level speedup within practical wall-clock development cost. In particular, it detected numerical discrepancies in five kernels caused by floating-point and intrinsic-function differences, including threshold-sensitive branch divergence and cancellation effects, enabling feedback to the application developers. The case study suggests that, for large legacy scientific applications requiring dump-based validation, practical AI-assisted GPU porting must manage session-spanning context, runtime-state reconstruction, and costly recovery from small static-analysis omissions. These findings demonstrate that AI-assisted GPU porting requires not only code generation, but validation-centric workflow design.