There was a decline in brain size that greatly predated widespread literacy:

https://www.bbc.co.uk/future/article/20240517-the-human-brai...