Chat with multiple LLM at the same time
planned
Z
Zach
Hi endu! Do you happen to have a status update on when this will be implemented? Thank you!
endu
Zach its already implemented in our dev version just testing out some bugs and edge cases.. would be pushed to prod soon :>
G
Guy
This would be helpful.
I also like their feature where you can generate a version which mixes the best of all the LLM results in to one "super" version.
endu
Merged in a post:
Multi-LLM support
w
wizk
Hi,
Please add option to run multiple LLMs at the same time. For example see Straico.com
endu
planned
endu
Zach thanks for your suggestion; We're actually working on making it possible to chat with multiple LLMs at once, and it'll be available to you soon.
We'd love to hear more about how you plan to use this feature so we can tailor it to your needs. Feel free to share your thoughts :)
Z
Zach
endu Oh that's awesome! Uses would be for comparing code mostly between models.
endu
Zach ahh .. gotcha, you would be able to do that with the new UI, :) once in prod do test it out and let us know if that sorts things out for you or not!
Z
Zach
endu Thanks for being so responsive to user requests, really appreciate it!
G
Guy
endu Not just code - any text.
endu
Guy certainly you will be able to do that aswell
R
Ryan
endu
Another use would be for roleplay chat and collaborative storytelling. A single LLM has difficulty keeping characters separated
J
JS
This would be useful.
I don’t fully trust any single LLMs and usually run the same query through GPT 4o and Claude 3 Opus just to see which gave a better response.
I only do this for more complex queries because it burns a lot more credits.