Most of them don't expose more than top_p/top_k/temperature. Those are woefully inadequate compared to what open source inference engines support.
Most of them don't expose more than top_p/top_k/temperature. Those are woefully inadequate compared to what open source inference engines support.