> why would any (self-interested) researcher or institution choose to work for the government vs. private industry

For the same reason researchers choose to do so now: the government pays for a lot more fundamental research than private industry does.