Re: Dead Cat
I don't think they can do that without also breaking their WiFi networks.
48 posts • joined 28 May 2018
While sample efficiency is kind of a problem for many AI things, I don't agree with your explanation for why it happens or suggested fixes. Firstly, the comparison of parameters to human neurons is somewhat inaccurate, since actual human neurons are each connected to many others, and a parameter is kind of sort of analogous to the strength of one of those connections. Secondly, you can definitely develop some understanding of the world just from seeing text - natural language is a very rich source of information about all kinds of things, both because of direct explanations like on Wikipedia and the ability to make inferences from patterns of word use - for example, if you don't know what fire is, you can probably develop a rough understanding from e.g. references to it being warm, use of wood or other things to fuel it, and water stopping it from working. And having world models like this is incentivized, since knowing more general information allows more general and accurate text predictions than just directly memorizing which words are near each other often. I also think giving AIs robotic bodies is very wasteful, given that real-world interaction would act as a massive bottleneck, and that the idea of using other types of data (images, audio, etc) which can be obtained easily in bulk to augment textual training has already proven massively successful (see CLIP).
About your suggestion regarding exploits in devices: if governments are just meant to hoard security issues in everyone's devices, and then give access to these to every government department that wants to access someone's stuff, that's basically as bad if not worse as some system which "only" gives the government plaintext access to all communications.
This reminds me of that Malcom Turnbull (former Australian Prime Minister) quote: "The laws of mathematics are very commendable, but the only law that applies in Australia is the law of Australia". It was on the same subject, too, in which he insisted that they needed encryption which was magically secure against evil hackers but also insecure if a Good Guy™ wanted access.
Biting the hand that feeds IT © 1998–2022