I have a similar experience, I think integration overhead is also a big part of it. Running tests, linting, verifying commits are matching repo conventions, rebasing before pushing, are all tasks that are roughly constant per story, so smaller stories pay a bigger chunk of overhead.