does merlin limits context window? | Mobile Feedback/Bugs

does merlin limits context window?

complete

Rudi Adianto

some llm has big context window for example Gemini 1.5 Pro that comes with 2 million tokens. Can we use all the 2 million tokens through Merlin?

Siddhartha

marked this post as

complete

Siddhartha

we actually use RAG to work with large files/links. Although in terms of input text, we accept anything thats less than 13K tokens.