Re: A 176-billion-parameter NLP
I once constructed a list of the words I use, to support a spellcheck program. I was using about 5,000 root words; with plurals, verb forms,etc, that became about 20,000 words.
Select 5 from 20,000 and that is a lot of short sentences, most of which are impossible. The fun starts if you want to guess what the possible ones might mean, for purposes such as translation, indexing and filing, and customer service.
I suspect the current brute force approach is running out of steam. For example, machine translations are less worse than they were, but still not up to a standard anyone would pay for.
Biting the hand that feeds IT
