Fix computer that cannot boot after reinstalling CMOS battery

How silly. It took me hours to find this out on the internet:

Unplug the power, hold down the power button and plug it in and it will work

So easy!