Could this be generalized? A wrapper that intercepts I/O syscalls to the filesystem of a remote client? This would work with binaries other than ffmpeg.

That's exactly what I set out to do with my pet project :)

https://github.com/Overv/outrun

Yes, apply the patches on any binary, build it and rename it to ffmpeg and it’ll work over the network with the server and client included