BYOK (Bring Your Own Key) when Monthly Query Runs Out
DL
I am trying to be a heavy user of Merlin by using it for everything daily. I also want to use it for coding interpretation more since it has multi-LLM and code interpretator integrated. However when we use code interpretation, it eats up query really fast.
To make the cost realistic, can you kindly allow BYOK when our monthly credit run out? Since you mentioned you are no profiting from the credits, this will be a Win/Win for you and the users.
Thank you!
Mehul
open
Mehul
Hi buddy,
Thank you for reaching out and for your enthusiasm in using Merlin for your daily tasks, including coding interpretation. We're glad to hear that you're finding the multi-LLM and code interpretator features valuable!
I'd like to inform you that the BYOK (Bring Your Own Key) functionality is already in place to address the concern you mentioned. When your monthly query quota is exhausted, Merlin will automatically start utilizing your API key, ensuring you can continue your work seamlessly without any interruptions. This setup indeed creates a win-win situation for both you and other users, allowing uninterrupted access while managing costs effectively.
DL
Mehul oh I didn't notice that sorry! But can I know if it's only for OpenAI? Or does it also allow for other vendors?
I will probably need Claude for coding purposes.
Mehul
DL: Yes as of now it supports OpenAI only. We haven't planned any other vendors yet. Keep an eye on our roadmap to stay updated if we plan to add it later on.
DL
Mehul thanks. This is definitely essential. If the BYOK is only with OpenAI then people lose their purpose of using Merlin. Any other took can connect to OpenAI quickly.
This is the Strong suit of Merlin, Multi-LLM.
Mehul
DL: We understand you 🤝. We are trying our best to provide this feature as well, but currently it is technically very complicated for us to implement it. So it will take sometime.