Would that US citizen be even better off if we got rid of all the other Americans so they had to compete against nobody?

Immigrants contribute to both supply and demand. It's not at all obvious whether this is net good or bad for natives' pay.