Depending on what you configured. It can also keep the mail on the server.