I had the same experience with matrix.org, then I set up my own homeserver and it it became a LOT more snappy. Its not perfect, but its been an adequate replacement for me and my few friends who are interested in self-hosting our own services.