Do not blaspheme against the mighty XOR
Don't blame the XOR. If I were to use a one-time pad to apply a sequence of bytes to my data using XOR, my code would be unbreakable. Therefore XOR is not a weak link. You'd have trouble managing such keys to cover unlimited data, but that isn't the XOR's fault.
You might as well say that the processor can't be expected to do much, because it's only manipulating a bag of bits using very simple operations.