I can not understand how this hasn’t been capitalized on more yet! Companies with the data MUST be training on it as RLHF, right?
In general, the “chat history mining” sector seems to be way under-developed to me so far.
All the damn time I am annoyed I have to re-tell my LLM a piece of info I have already told it a few weeks ago - finding the chat takes too long and the full history may not be relevant, but the fact wasn’t interesting enough to manually add to memory.
With the right memory system, the LLM could just know!
Does anyone have other interesting examples of this principle being applied?
fliellerjulian 2 days ago [-]
100% feel the same way. I´ll look into building an API for that so more people/companies can use it.
solarkraft 2 days ago [-]
Note that you posted an “Ask HN” (with it linking to this page) - do you want to show us something instead?
fliellerjulian 2 days ago [-]
oh my bad, thanks for flagging. I dont have a link to anything thats why I did do Show HN
berkethebooss 3 days ago [-]
for now we just use normal system memory the user can maintain himself - not the best solution but better than nothing.
fliellerjulian 3 days ago [-]
we did the same thing, but we noticed most users did not maintain their own system memory themself properly. so we had to build a solution that auto-manages memory and preferances.
Rendered at 12:44:35 GMT+0000 (Coordinated Universal Time) with Vercel.
I can not understand how this hasn’t been capitalized on more yet! Companies with the data MUST be training on it as RLHF, right?
In general, the “chat history mining” sector seems to be way under-developed to me so far.
All the damn time I am annoyed I have to re-tell my LLM a piece of info I have already told it a few weeks ago - finding the chat takes too long and the full history may not be relevant, but the fact wasn’t interesting enough to manually add to memory.
With the right memory system, the LLM could just know!
Does anyone have other interesting examples of this principle being applied?