618MB later...
OK, I downloaded my data and tried to find the juiciness. Yes, there is much contact information in there that goes above and beyond anything expressly shared - though not to the detail of call logs. However I do remember occasionally doing a "upload my Thunderbird address book to find friends" a few times historically, although I'm pretty sure that clearly said it would be used for nothing else, but not necessarily that it wouldn't be kept on file "just in case". However the key thing for me (if not data protection lawyers) is that just because Facebook are keeping this data doesn't necessarily mean they are sharing it with anyone. Of course not guaranteed, and it's "in there" if they chose to or were hacked. I'm not sufficiently familiar with the API to know quite what is passed when users agree certain permissions for apps etc, but I rather doubt the detail of information seen here would be part of the deal. So probably a bit of an over-reaction, but still cause for concern given the risk of data breach or past/future malevolence.