I absolutely agree. You are just moving the lack of representation to the next level if you increase the size of the house. House members need to know each others and works with each others to be effective. And this is where math says things turn ugly, the size of the graph connecting all house members grows exponentially, until at a certain size (which I believe we have already reached) it is simply unmanageable. the solution might be to add yet another layer in the system. Naively, it seems that democracy is hard to scale (this does not mean that we should no try though). But last time I tried to bring up that concern on HN it did not go well...
Members of the House of Representatives’ first obligation to my view is knowing their constituents. Knowing each other may not help as much as you may think unless you’re on a committee. As the population increases, members of the House were meant to increase. This increasing size has been arrested.