Improve AI hallucinations
under review
Y
Yume
Noticed that there's a LOT of AI hallucinations when using Merlin. A LOT. Almost like using Google AI is better directly. I have fact checked so much the AI hallucinations in Merlin to date vs Google AI (which is free) and it's astounding how much the Merlin AI is basically just lying, making up data or not citing info correctly despite having access to the www. What can be done about this?
S
Shubhankit Jain
Hi Yume & Hernan D Delgado R,
Thanks for flagging this issue! We've been working to address the hallucination and citation accuracy problems you reported.
We've released some updates to our web search and citation system last week and yesterday specifically to reduce fabricated links and improve source reliability in chat.
Could you let us know if you're still experiencing this issue? If you've used Merlin chat recently, we'd really appreciate clarity on:
Are citations/links still being made up?
- Is the accuracy better, or are you still seeing the same problems?
- If the issue persists, please share a recent chat link or screenshot so we can investigate further. You can attach it here or email us at support@getmerlin.in.
Looking forward to your feedback!
Vijay Bharadwaj
marked this post as
under review
Vijay Bharadwaj
Hi Yume. Really sorry for this bad experience. Could you either attach some shared Merlin chats here, or send them to me at vj@foyer.work so that I can have a look?
Thanks for reporting!
Y
Yume
Vijay Bharadwaj Mostly it happen when we asking Merlin to cite the source. It makes up the information and links. I will dig up a couple discussions where it says it makes it up even if the directive is the opposite. It's crazy.
Hernan D Delgado R
Vijay Bharadwaj I will gladly provide some Merlin chats with hallucinations when referencing for your assessment and troubleshooting. Have a good day!
Y
Yume
Hernan D Delgado R Thanks I haven't had time to dig back through. Appreciate it but everyone working in AI should know AI hallucinations exist... technology is not a perfect science.