I'm been working 15 hour days on a side project in ai, and I keep coming back to wanting to eventually build something in the space that deals with memories, retention, context etc....<p>I'm not sure if it'd be just different models or a vector database with some way of partitioning data and maybe reorganizing and pruning less needed data.<p>as I burn out coding and I'm usually ending up stuck on something I sleep and work the code out in my sleep, I'm not sure what the equivalent to that would be for machines, but some sort of defragging could maybe be good for the system.