Actively invested retirement funds throughout 30+ years can also catch more concentrated moves if you are educated on a sector. For example, choosing the mag7 in the early 2010s vs just the SPY. Following the market could also let you pull out during serious world events.
There is definitely money left on the table when you ignore the market, even in a retirement fund.