You can leave memory enabled and tell it to not use memory in the prompt of it's interfering.