> Sure they aren't as good as the big providers
If you haven't done so already, finetune the model on all your company's code that you can get your hands on. This is one of the great advantages that you get when running local models. I like the style of the generated code much better now, I have to rewrite much less, and my prompts can be shorter too. But maybe these already are the "tweaks" that you mentioned.
How would they do that? Would it be as easy as telling a model "Hey, review all this code, identify patterns, and then write in this style going forward"?
Sorry if this is a stupid question, I've never finetuned or trained a LLM.
Unsloth has consumer accessible stuff on fine tuning models