Is there some kind of memory enabling, for instance, an agent to remember guidelines on a repo without having to feed at the beginning of each session 4 markdown files and spending the corresponding tokens each time ?

No, it's all just prompts.

You can try to summarize memories tersely and point the agent to longer markdown files, but who knows if it will read it at the right time and only then.