Tried ChatRTX
I've not tried RAGs in nearly this detail. The closest I came was to install Nvidia's ChatRTX, which uses RAG to access external libraries.
Then, to test it, I downloaded numerous texts about Ancient Egypt from Wikipedia and a few other sources. I then asked it questions, checking the results against the pages I gave it.
The results were utter garbage. Not only was it often incorrect, but at times, it brought up information that contradicted what I had supplied.
When I asked Nvidia about this, they said, "Give it more data". But unless companies are in the habit of duplicating and rewriting their documents, I'm not even sure what "more data" means in the context of RAG use cases.
I'll work through this tutorial to see if I get better results. But I wonder if people are glossing over how inaccurate these systems can be. For example, would you trust a model like this with your tax calculations?