If this is mostly because of the size of the system prompt, then perhaps in long horizon tasks the "tax" will be less obvious.