I built something similar for my needs[1]. I really like your idea of having write-gated memories.

[1] https://github.com/sibellavia/dory

Nice, just looked at dory. Cool to see different takes on the same problem. The write gate and the manual curation approach converge on the same insight: the model shouldn't necessarily decide what's permanently important.