The increase is 10% or so IIRC. So still not that significant. In our modern life most of the energy spent is to keep you alive.

And you have upper limit on your BMR - you have to maintain a steady temp. We just cannot dissipate much more than currently before cooking ourselves medium rare.