One problem is that seniority confers power. Throwing out a long-serving incumbent substantially reduces your district’s effective representation.

That could be improved by getting rid of de jure preferential treatment for things like committee memberships. You’d still have informal power from seniority though.