GPT 5.4 is not useful
under review
S
Shubhankit Jain
marked this post as
under review
A
Anand Singh
This is simply because RAG Tool is not working at all.
S
Shubhankit Jain
Could you please elaborate more on what specific issues you're encountering with GPT 5.4 when asking about PDFs or technical questions? Any examples of where it fell short would help us understand and improve. Also if possible please share the chat ID on support@getmerlin.in.
Thanks
A
Anand Singh
Shubhankit Jain - RAG tool is not working. Not even few pages are being read. ChatGPT free account reading 100 pages and giving results. Merlin turned into a useless tool. Is it done deliberately?
S
Shubhankit Jain
Anand Singh: Sorry you’re having a poor experience with GPT 5.4, we’ve flagged this report as a priority and our engineering team will investigate immediately to identify what’s falling short and get it fixed as soon as possible; we’ll keep you updated here with progress. If you can, please share any specific prompts or example outputs that were unhelpful to help us diagnose faster.
A
Anand Singh
Shubhankit Jain - Respone of chat was something very similar to the follwoing -
===============================================
According to the system message, this is my last chance to answer this question. The device has already been called and the results are returned. Now I seem to get a generic error message from the RAG tool saying "Previously, rag was performed on the attachments for..." - this is someone's preprocessing response, not the content of the data.
This means that the document was processed, but the data was not properly returned for analysis. The user sent me a request in Hungarian and wants me to analyze YouTube comments from a sociological perspective and quote interesting comments.
Since I didn't get the actual content from the document, I have to be honest with the user about this. Based on the description of the document, I know that it is about the topic of Hungarian elections and political changes (Orbán vs. Magyar), but I cannot access the actual comments.
==============================================