And how do you decide who is going to throw that one die?

Literally doesn't matter, player closest to dice at the moment you open the box.