How much memory does this use of the test machine's (M3 Max) 128 GB unified memory?
The model is only 0.3B params so probably not much.
Physical footprint: 560.4M Physical footprint (peak): 778.0M
The model is only 0.3B params so probably not much.
Physical footprint: 560.4M Physical footprint (peak): 778.0M