How do you ensure that subset of the weights will continue to be accessible through the others?

I don't understand your question.