Actually, by the Kramers-Kronig relation you can infer the imaginary part just from the real parts, if given that your time signal is causal. So the phase isn’t actually lost in any way at all, if you assume causality.

Also, pedantic nit: phase would be the imaginary exponent of the spectrum rather than the imaginary part directly, i.e, you take the logarithm of the complex amplitude to get log-magnitude (real) plus phase (imag)