We have a flexible backend that can easily use any model. We could even let the user decide. But I've never seen any site that allows the user to choose the model for the agent. I wonder why.
We're still working on this , but yes, we will have it all available soon for download.
Good idea for a "tool" that allows the LLM to read the ranking system. All we need to do is add to the prompt which ranking system the screen uses and the LLM can then use the tool to read it. Thanks
Community intelligence?
The other focus are right now is to create RAG data of examples and Q/A. It's very time consuming for us, and not diverse enough. It might be worth setting up an easy way for anyone to contribute Q/A, and examples. All we would need to do is quickly review submissions before adding them to the RAG
Since we seem to have a “strong explainer / weak creator” , another option is to leverage the current ability to explain rules to create the RAG data. Perhaps also cherry pick from public screens for diversity. A quick research seems to indicate this is a good strategy ChatGPT - RAG Use of Explanations