Have you considered fine-tuning on your dataset?

Seeing the fine-tuning guides that are coming out with LFM3, I am now considering it :)

Would be a fun experiment.