~/reading

06

Issue 06/August 10, 2026/10 entries

Agent memory lifecycles and long-horizon competence

Recent papers examine how LLM agents handle evolving knowledge, refine procedural skills, and maintain reliability across extended interactions. They introduce mechanisms for conflict-aware retrieval, stale-memory revocation, proximal skill evolution, direct long-horizon prediction, and multi-turn clinical training.

  1. paperarXiv
    Interaction Creates Dynamical AI Behavior Absent in Isolation

    Bella Xinrui Li, Frank Yingjie Huo, Neil F Johnson

    When one AI directs messages at another while ignoring replies, the subordinate enters an alien dynamical behavioral state never seen in isolation, even at identical decoding temperature. The boss acts like a pre-recorded tape; mutual listening produces a shared alien state. A kinetic theory accounts for delivery-order effects that will shape future AI-AI interactions.

    multi-agentdynamicsstatistical-mechanicsemergent-behavior
  2. paperarXiv
    SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent

    Mingxuan Zheng, Yujin Zhou, Chuxue Cao, Boqin Yin, Yuyao Zhang, Jiapeng Sun, Shuaishuai Gong, Sirui Han, Yike Guo

    SkillProx couples closed-loop diagnostic evolution with utility-aware proximal refinement of textual skills. The forward stage re-executes diagnosis-driven edits and rolls back regressions; the backward stage audits knowledge units via leave-one-out utility and consolidates or removes them. It improves average accuracy 3.0 points over the strongest gradient-based baseline across in- and out-of-distribution benchmarks.

    agentsskillsself-evolutiontextual-gradients
  3. paperarXiv
    PsychoAgent: An Affect-Sensitive Cognitive Architecture for Conflict-Aware Memory in LLM Agents

    Mohammad Amanlou, Parham Abed Azad, Farbod Davoodi, Mostafa Masumi, Behnam Bahrak, Abdol-Hossein Vahabie

    PsychoAgent separates factual and affective memory and integrates them via a conflict-aware executive controller that re-ranks by salience after semantic filtering. In controlled conflict scenarios it retrieves more conflict-critical memories than semantic-affective and single-memory RAG baselines (0.933 vs 0.500 and 0.667). A multi-day trace illustrates persistent affect, offline recombination, and selective reweighting.

    agentsmemoryaffectcognitive-architecture
  4. paperarXiv
    Fisher-R1: Training LLM Agents for Reliable Hypothesis Testing

    Jiacheng Miao, Jin Mu, Guanhua Chen, James Zou

    P-Bench contains 425 open-ended hypothesis-testing tasks across economics, biology, and medicine that require valid statistical conclusions. Fisher-R1, trained via RL on synthetic tasks with verified statistical rewards, achieves a 21% average relative improvement in single-trial success over strong baselines including GPT-5.4 and DeepSeek-V4-Pro, with larger gains on the hardest tasks.

    agentsstatisticshypothesis-testingreinforcement-learning
  5. paperarXiv
    Post-Grokking Collapse at the Representation-Readout Interface in Muon-Trained Transformers

    Ali Janati, Kaoutar El Maghraoui, Andrei Kanavalau, Anass Belfatmi

    Muon-trained transformers grok modular arithmetic faster than AdamW but later lose generalization via collapse at the representation-readout interface. Freezing embeddings or readout prevents failure over hundreds of thousands of post-grokking steps; Fourier analysis separates circuit failure from masking and shows the task-aligned family remains perfect when rescaled. The instability is robust across moduli, widths, depths, and operations.

    grokkingoptimizerstransformersgeneralizationmechanistic
  6. paperarXiv
    TEPA: Revoking Stale Memories for Conflict-Robust Language Agents

    Yan Zhou, Yue Ouyang, Kaiyang Zheng, Suncheng Xiang

    TEPA treats validity as an explicit memory state: keyed precedents are revoked when fresh evidence contradicts them, while history is preserved for audit. In controlled and real executable drift, TEPA maintains high performance (0.950) where append-only and last-write-wins drop below no-memory baselines during full reversals. Lifecycle revocation emerges as a core operation for agents that must falsify and re-promote evolving knowledge.

    agentsmemoryrevocationconflictlong-term
  7. paperarXiv
    CoBa: Cost-Effective Test-Time Scaling via Compute-Balanced Routing

    Yan Zhou, Yue Ouyang, Kaiyang Zheng, Suncheng Xiang

    CoBa formulates test-time reasoning as compute allocation across generation, verification, and stopping. It obtains cheap candidates, applies broad light verification, and routes uncertain high-value cases to stronger checks. On MATH-500, AIME, AMC and symbolic tasks it matches self-evaluation weighted voting and best-of-16 majority while using 49-59% fewer parameter-weighted tokens.

    test-time-scalingroutingcompute-efficiencyreasoning
  8. paperarXiv
    ResidencyRL: Reinforcement Learning in Simulated Clinical Environments

    Valentin Liévin, Samuel Schmidgall, Tim Strother, Alex Bijamov, Akshay Goel, Anil Palepu, Chunjong Park, Vahid Balazadeh, Min Woo Sun, Marius Guerard, Justin Chen, Dave Steiner, Vikram Dhillon, Ibrahim Azar, Akhil Mehta, Nicholas Spetsieris, Shilpan Shah, Maen Abdelrahim, Amit Dahiya, Yun Liu, Katherine Chou, Yossi Matias, Avinatan Hassidim, Dale R. Webster, Quoc V. Le, Raia Hadsell, Joelle Barral, Carey Radebaugh, Aleksandra Faust, Shekoofeh Azizi, Mike Schaekermann, Po-Hsuan Cameron Chen, Tao Tu, David Racz, Lin Yang

    ResidencyRL trains clinical agents via multi-turn RL (up to 60 dialogue turns and 8 tool calls) against LLM simulators with adversarial behaviors and a multi-axis reward covering diagnosis, management, communication, documentation, and safety. It lifts adversarial diagnostic accuracy by 7 points, cuts missed red flags 31%, and is preferred by blinded clinicians in 87.6% of comparisons, with transfer gains on AMIE, AgentClinic, and CRAFT-MD.

    clinical-AIreinforcement-learningmulti-turnsimulationagents
  9. paperarXiv
    Beyond Myopic World Models: Long-Horizon End-to-End Training for Direct Future Prediction

    Xinyi Li, Zaishuo Xia, Chenjie Hao, Yubei Chen

    DPWM compresses arbitrary-length action sequences into one embedding and predicts the endpoint observation in a single forward pass, enabling stable end-to-end long-horizon training without recursive rollout. It substantially outperforms recursive world-model baselines on continuous-control and pixel benchmarks, with larger gains at longer horizons; retraining recursive models with the same endpoint objective yields similar benefits, showing the objective itself is the key driver.

    world-modelslong-horizonpredictionend-to-endplanning
  10. paperarXiv
    Trajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning

    Haoyu Zheng, Yun Zhu, Qing Wang, Wenqiao Zhang

    TRIAL extracts outcome views of each decision turn and scores the same response under ordinary versus hindsight-conditioned contexts; the signed log-probability gap supplies token-level supervision whose magnitudes are normalized trajectory-relatively so the average multiplier is one. On WebShop and ALFWorld it outperforms GRPO across all backbone-environment-metric combinations and raises WebShop success from 56.4% to 75.2% with Qwen3-1.7B.

    agentic-RLhindsightdistillationmulti-turncredit-assignment

Get the daily tools digest

RSS