Re: Hallucinations
I had similar experience.
That it is rather slow just running on a CPU is not that surprising and is something I would be willing to put up with to avoid sending any of my information to wherever.
Ask it to create a response to a complaint letter, or produce a vision statement for an organisation and it will quite happily produce some reasonably coherent looking generic output, though when you ask it to refine its response by including reference to something specific it does tend to go overboard. Appears reasonably clever but not really an improvement on the much simpler template responses we've had for years - and in some respects potentially worse as it's responses may not be consistent and it is obviously more compute resource intensive.
For 'factual' output it performed reasonably well when I asked it for ' the speed of sound on mars' giving both an acceptable answer and it's 'reasoning' - though for such things you are better off just using the search engine of you choice.
For something slightly more taxing, rather than just admiting it doesn't know it makes semi-convincing looking sh!t up and when challenged will modify it's response to cover some of what you have told it but won't admit that what it has originally spouted is garbage.
I asked it to list alumnii from my school - It claimed that it was a prestigeous private preparatory school in Hertfordshire founded a feww hundred years ago and listed a whole range of alumini -including John Major and Andrew Flintoff including incorrect year of birth. When I corrected it that my school was in Lincolnshire it appologised for the confusion and claimed my school was a modern local authoritycomprehensive. Whilst I did get it admit my school was older(c 1532) it still insists it is a local authority comprehensive (it's not), would not accept that the one it made up did not exist and kept repeating its made up information on the non-existant establishment with just an passing refernce to the existence of the real esatablishment . At that point I got bored and gave up as it was like arguing with an obsequious but uninformed idiot who wont admit they are wrong.
Except for simple cases, by the time you have fact checked and manually modified it's output you might as well have looked up the information using the search engine of your choice and written it yourself. Unfortunately I think we will find that a lot of people will just use this sort of technogy and accept what it gives them without checking for even obvious errors.