For the uneducated, how large is too large? Curious.

FAISS runs in RAM. If your dataset can't fit into ram, FAISS is not the right tool.