06
Agent memory lifecycles and long-horizon competence
Recent papers examine how LLM agents handle evolving knowledge, refine procedural skills, and maintain reliability across extended interactions. They introduce mechanisms for conflict-aware retrieval, stale-memory revocation, proximal skill evolution, direct long-horizon prediction, and multi-turn clinical training.
- paperarXivInteraction Creates Dynamical AI Behavior Absent in Isolation↗
Bella Xinrui Li, Frank Yingjie Huo, Neil F Johnson
When one AI directs messages at another while ignoring replies, the subordinate enters an alien dynamical behavioral state never seen in isolation, even at identical decoding temperature. The boss acts like a pre-recorded tape; mutual listening produces a shared alien state. A kinetic theory accounts for delivery-order effects that will shape future AI-AI interactions.
multi-agentdynamicsstatistical-mechanicsemergent-behavior - paperarXivSkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent↗
Mingxuan Zheng, Yujin Zhou, Chuxue Cao, Boqin Yin, Yuyao Zhang, Jiapeng Sun, Shuaishuai Gong, Sirui Han, Yike Guo
SkillProx couples closed-loop diagnostic evolution with utility-aware proximal refinement of textual skills. The forward stage re-executes diagnosis-driven edits and rolls back regressions; the backward stage audits knowledge units via leave-one-out utility and consolidates or removes them. It improves average accuracy 3.0 points over the strongest gradient-based baseline across in- and out-of-distribution benchmarks.
agentsskillsself-evolutiontextual-gradients - paperarXivPsychoAgent: An Affect-Sensitive Cognitive Architecture for Conflict-Aware Memory in LLM Agents↗
Mohammad Amanlou, Parham Abed Azad, Farbod Davoodi, Mostafa Masumi, Behnam Bahrak, Abdol-Hossein Vahabie
PsychoAgent separates factual and affective memory and integrates them via a conflict-aware executive controller that re-ranks by salience after semantic filtering. In controlled conflict scenarios it retrieves more conflict-critical memories than semantic-affective and single-memory RAG baselines (0.933 vs 0.500 and 0.667). A multi-day trace illustrates persistent affect, offline recombination, and selective reweighting.
agentsmemoryaffectcognitive-architecture - paperarXivFisher-R1: Training LLM Agents for Reliable Hypothesis Testing↗
Jiacheng Miao, Jin Mu, Guanhua Chen, James Zou
P-Bench contains 425 open-ended hypothesis-testing tasks across economics, biology, and medicine that require valid statistical conclusions. Fisher-R1, trained via RL on synthetic tasks with verified statistical rewards, achieves a 21% average relative improvement in single-trial success over strong baselines including GPT-5.4 and DeepSeek-V4-Pro, with larger gains on the hardest tasks.
agentsstatisticshypothesis-testingreinforcement-learning - paperarXivPost-Grokking Collapse at the Representation-Readout Interface in Muon-Trained Transformers↗
Ali Janati, Kaoutar El Maghraoui, Andrei Kanavalau, Anass Belfatmi
Muon-trained transformers grok modular arithmetic faster than AdamW but later lose generalization via collapse at the representation-readout interface. Freezing embeddings or readout prevents failure over hundreds of thousands of post-grokking steps; Fourier analysis separates circuit failure from masking and shows the task-aligned family remains perfect when rescaled. The instability is robust across moduli, widths, depths, and operations.
grokkingoptimizerstransformersgeneralizationmechanistic - paperarXivTEPA: Revoking Stale Memories for Conflict-Robust Language Agents↗
Yan Zhou, Yue Ouyang, Kaiyang Zheng, Suncheng Xiang
TEPA treats validity as an explicit memory state: keyed precedents are revoked when fresh evidence contradicts them, while history is preserved for audit. In controlled and real executable drift, TEPA maintains high performance (0.950) where append-only and last-write-wins drop below no-memory baselines during full reversals. Lifecycle revocation emerges as a core operation for agents that must falsify and re-promote evolving knowledge.
agentsmemoryrevocationconflictlong-term - paperarXivCoBa: Cost-Effective Test-Time Scaling via Compute-Balanced Routing↗
Yan Zhou, Yue Ouyang, Kaiyang Zheng, Suncheng Xiang
CoBa formulates test-time reasoning as compute allocation across generation, verification, and stopping. It obtains cheap candidates, applies broad light verification, and routes uncertain high-value cases to stronger checks. On MATH-500, AIME, AMC and symbolic tasks it matches self-evaluation weighted voting and best-of-16 majority while using 49-59% fewer parameter-weighted tokens.
test-time-scalingroutingcompute-efficiencyreasoning - paperarXivResidencyRL: Reinforcement Learning in Simulated Clinical Environments↗
Valentin Liévin, Samuel Schmidgall, Tim Strother, Alex Bijamov, Akshay Goel, Anil Palepu, Chunjong Park, Vahid Balazadeh, Min Woo Sun, Marius Guerard, Justin Chen, Dave Steiner, Vikram Dhillon, Ibrahim Azar, Akhil Mehta, Nicholas Spetsieris, Shilpan Shah, Maen Abdelrahim, Amit Dahiya, Yun Liu, Katherine Chou, Yossi Matias, Avinatan Hassidim, Dale R. Webster, Quoc V. Le, Raia Hadsell, Joelle Barral, Carey Radebaugh, Aleksandra Faust, Shekoofeh Azizi, Mike Schaekermann, Po-Hsuan Cameron Chen, Tao Tu, David Racz, Lin Yang
ResidencyRL trains clinical agents via multi-turn RL (up to 60 dialogue turns and 8 tool calls) against LLM simulators with adversarial behaviors and a multi-axis reward covering diagnosis, management, communication, documentation, and safety. It lifts adversarial diagnostic accuracy by 7 points, cuts missed red flags 31%, and is preferred by blinded clinicians in 87.6% of comparisons, with transfer gains on AMIE, AgentClinic, and CRAFT-MD.
clinical-AIreinforcement-learningmulti-turnsimulationagents - paperarXivBeyond Myopic World Models: Long-Horizon End-to-End Training for Direct Future Prediction↗
Xinyi Li, Zaishuo Xia, Chenjie Hao, Yubei Chen
DPWM compresses arbitrary-length action sequences into one embedding and predicts the endpoint observation in a single forward pass, enabling stable end-to-end long-horizon training without recursive rollout. It substantially outperforms recursive world-model baselines on continuous-control and pixel benchmarks, with larger gains at longer horizons; retraining recursive models with the same endpoint objective yields similar benefits, showing the objective itself is the key driver.
world-modelslong-horizonpredictionend-to-endplanning - paperarXivTrajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning↗
Haoyu Zheng, Yun Zhu, Qing Wang, Wenqiao Zhang
TRIAL extracts outcome views of each decision turn and scores the same response under ordinary versus hindsight-conditioned contexts; the signed log-probability gap supplies token-level supervision whose magnitudes are normalized trajectory-relatively so the average multiplier is one. On WebShop and ALFWorld it outperforms GRPO across all backbone-environment-metric combinations and raises WebShop success from 56.4% to 75.2% with Qwen3-1.7B.
agentic-RLhindsightdistillationmulti-turncredit-assignment