Admins: How about deploy a llm/RAG chain to improve forum search?
Moved
Unsolved
Brainstorm
-
I am surprised I haven't seen this much, but how about integrating a RAG pipeline to improve search of all the forum posts? Could cut down on duplicate posts and help people search faster. I haven't seen this in any forum products yet. Some of the smaller models are super cheap and totally sufficient. You could rate-limit users as well to keep costs down.
-
S SGaist moved this topic from General and Desktop