Re: Minimum spec?
Running the kernel and building the kernel are two very different workloads, the latter requiring far more horsepower. Most Linux users will never build their own kernel.
You can guarantee that Linus has other, lower powered devices for testing purposes, if only to keep his primary development and build machine (s) stable and clean.