This exactly. We run a 100KW microgrid on Hispaniola, and most of our panels are oriented to maximise winter afternoon sun, or just pointed randomly at the sky. Random pointing gets us more power than all oriented 12 degrees south because the power we care about is in overcast conditions, especially high altitude overcast, and that is variable in intensity in different sky regions on a minute by minute basis.
Also 12 degrees south would put a mountain partially in view of the panels, and mountains don’t provide much light here. (I don’t mean the mountains would block the sun, just a band of otherwise visible sky)
When we do have high intensity light, the late afternoon is when we want it, and also when the sun is most off to one side of the sky.
My advice: over panel as much as you can. We can fully charge our batteries while running the farm and 6houses in three hours of full sunlight, so we still get plenty on overcast days, and even on the few darkest days we make about 70%. We have to supplement the solar about 60 days a year total, burning a total of 300 gallons of fuel over the year for a small farm and 6 houses.