Re: a sufficiently motivated person could in fact find out exactly how I voted.
I wrote about this following the EU Referendum - http://blog.mrdrem.me.uk/2016/06/how-voting-works-from-other-side-of.html
TL:DR? Yes, your vote can be tracked, but only within certain timescales, and only with a court order (or some electoral services employee doing a shed load of work on the quiet, with no-one else noticing, or a load of people being in on it, at which point see https://www.theguardian.com/science/2016/jan/26/secret-success-equations-give-calculations-for-keeping-conspiracies-quiet - Although I suspect that less than the critical 125 people would know enough of how the data was gained)
I'm planning on writing something up about the counting process shortly...