So, does it help with context management or so called MemoryBank setup?

Yes, it has built in storage layer(Postgres and PGVector)