If this sort of thing doesn't terrify you, or if you think that the government won't abuse it, remember that the government has no reason not to do what ever it wants with this information, and that governments have no inherent moral restrictions.
British police have raped women who have then had children, all in the name of stopping ecological protests. They harvest data from every possible source. There are cameras everywhere, and now the police are trialling facial recognition tech.
The purpose of the state is to further the interests of those who control it and benefit from its monopoly on violence, and those people are inevitably the rich and powerful.
If you're not paranoid, you're not paying attention.