Can you replace S3 with a directory and nginx and save lot of money?

Yes. Especially if you use Storage Combinators.

They let you easily abstract over storage.

https://2019.splashcon.org/details/splash-2019-Onward-papers...

Yes, i.i.r.c. it's not S3 specific just URLs