Reading Notes of KVP: Learning to Evict from Key-Value Cache

Reading Notes of H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models