There are ways around this
These types of attacks have been known for years, as has the defense. At the cost of some energy efficiency, the hardware can calculate results for both a '0' and '1' in each bit of the key, and throw away the result it doesn't need.