Is the described behavior still the default with `op` cli?

Yes. At least on macOS.