Built similar focused specifically on planning annotations.

https://github.com/backnotprop/plannotator

It integrates with the CLI through hooks. completely local.