TE
TechEcho
Home
24h Top
Newest
Best
Ask
Show
Jobs
English
GitHub
Twitter
Home
Ask HN: How to store KV cache efficiently on disk?
1 points
by
ban-lan-gen
2 months ago
If I have a lot of precomputed KV cache values (basically just tensors), how do I store them efficiently on disk? Ideally, I would want to lookup their values by prefix quickly as well.
no comments
no comments