> Why couldn't the government rail do that before?

They didn't want to. Privatisation was the era of Thatcher and Major, the discovery of North Sea oil reserves, and of the same general desire to culturally align with US (including car culture) that to the uban design found in Milton Keynes 30 years earlier.