But what do you do with these secrets? Like tagging emails, summarizing documents?

a document management system is an easy example. Let’s say medical, legal, and tax documents.

Thank you, but what do you use the llm for? Writing new documents based on previous ones? Tagging/categorization/summarization/lookup? RAG? Extracting structured data from them?

Me personally, i’m using paperless-ngx to manage documents.

i use ollama to generate a document title, with 8 words or less. I then go through and make any manual edits at my leisure. Saves me time which i appreciate!

Paperless-ngx already does a pretty good job auto-tagging, i think it uses some built in classifiers? not 100% sure.