> maybe two models should be developed and trained in conjunction that talk to each other, each with different functions and roles, because brains work better this way.
I mean, is that not essentially what a Mixture of Experts model is?
> maybe two models should be developed and trained in conjunction that talk to each other, each with different functions and roles, because brains work better this way.
I mean, is that not essentially what a Mixture of Experts model is?
Ah, didn't know the term for this, but vaguely remembered articles multiple models being trained together. Good to know:)