How and where do you finetune it?

I use Modal for fine tuning and unsloth mostly.

Easy to do with Unsloth Studio.