can you tell me ideas of usecases of 9 or 10B language models ? I cant find any usecases other than training a lora on them to give good bash commands for example
can you tell me ideas of usecases of 9 or 10B language models ? I cant find any usecases other than training a lora on them to give good bash commands for example
9B Qwen models are good and fast for local python coding tasks.
they are all overlapping but:
categorization, information retrieval, semantic search, image description
also with the model as part of an agentic system with tool calling
(edit: it is quite impressive what a small model in a feedback loop can do)