Reading Notes of KVP: Learning to Evict from Key-Value Cache Instead of evicting KV cache with checking whether previous tokens contribute to the current one, learn to predict whether past tokens contribute to the future tokens. Prediction returns a sorted list 2026-09-03 Reading Notes > NLP > KV Cache #Reading Notes #NLP #KV Cache
Reading Notes of H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models Given current token, use the query to compute attention with keys in previous tokens. Evict n tokens with least attention scores. Any token that is not relevant to current position is removed (but nev 2026-09-03 Reading Notes > NLP > KV Cache #Reading Notes #NLP #KV Cache
Reading Notes of EvoDS: Self-Evolving Autonomous Data Science Agent with Skill Learning and Context Management A data science agent (Qwen3-8B backbone) trained end-to-end to (1) synthesize and reuse new skills and (2) decide when to compress its own context, via SFT distillation + multi-role GRPO. 2026-09-02 Reading Notes > NLP > LLM Agents #Reading Notes #NLP #LLM Agents
Reading Notes of ACM: Agentic Context Management for Long Horizon Tasks I like the idea of insertion / deletion decisions of context management by on policy distillation, but there should be more analysis here. Also, the comparison is not fair. The compute is not saved. T 2026-09-01 Reading Notes > NLP > LLM Agents #Reading Notes #NLP #LLM Agents
Reading Notes of ACON: Optimizing Context Compression for Long-horizon LLM Agents I like the story of this paper to optimize cost, but it spends a long time introducing cost optimization objective while it actually uses iterative prompt engineering, which seems to be totally irrele 2026-09-01 Reading Notes > NLP > LLM Agents #Reading Notes #NLP #LLM Agents
Blackjack 数学推导 去拉斯维加斯接触到这个东西, 查了下数学还挺有意思的 (没那么难也没那么简单那种), 一开始凭借直觉输了 70 USD, 于是回头推导了一下. 截图来自: 247blackjack.com. 2026-08-29 Maths > Probability #Probability
Reading Notes of How does GPT Obtain its Ability? Tracing Emergent Abilities of Language Models to their Sources Reading notes of Yao’s notes of How does GPT Obtain its Ability? Tracing Emergent Abilities of Language Models to their Sources (notion.site). 2023-02-19 Reading Notes > NLP > ChatGPT #Reading Notes #NLP #ChatGPT
Huggingface parallel training for solving the CUDA out of memory issue Document a workable solution for the annoying CUDA Out Of Memory (OOM) 2023-02-12 Tech Essays #Tech Essays