What I'm building has a regular maintenance it runs across the knowledge. A. to chunk long articles down into smaller chunks or information with good routing. B. To review the latest thinking to make sure old thinking is deprecated and linked.

This will be the big challenge with this. Storing/Retrieving works fine across hundreds of articles... I have more than 500 right now just from OzBrain and a bit of the thing I was building before. When it becomes thousands with dozens being added all the time, the maintenance will become more of a necessity.

I lean a little bit towards store everything because the system's abilities are changing so fast right now, that having our previous thinking or reasoning is useful in being able to improve or correct current assumptions based on previous data.