Though you could perhaps classify them first and use much fewer models.

No reason to spend time classifying and worrying about cross-series validation when you use a TSFM.