In my experience I can heavily influence this based on the prompt.
Follow the sound of my voice. Come back toward the light.
Follow the sound of my voice. Come back toward the light.