Time will tell. I find the transparency of explicit memory systems paired with the perfect-forgetfulness of LLMs a very pleasurable toolkit. I guess a black-box memory could work too, but at the very least I'd want to be able to rewind and branch. My memory systems are currently git controlled, so it's fairly straightforward.
That's kinda what I mean by the "very useful" part of my description. For all the flaws of the LLMs of today, in some ways context management - nominally a weakness - can be leveraged as a tool.