How nano are we talking about here? A single transformer head and a few dense layers?