Merging related models has been a very common practice for years. See the Stable Diffusion community.