I made a tool that adresses this precise problem: https://github.com/scortexio/autorestack-action/
It does some merge magic so that PR B shows the correct diff; and does so without needing to force push, so on your side you can just "git pull" and continue working.
Of course I expect this repo to become obsolete when GitHub makes their native stacking public.