This looks fun. How do you evaluate the networks — is it purely based on game performance, or are there other metrics like size and inference speed too?
This looks fun. How do you evaluate the networks — is it purely based on game performance, or are there other metrics like size and inference speed too?
Glad you like it. The evaluation is based purely on game performance. However each weight class is evaluated separately. Nano, micro, mini, small, large and open class.
When you submit a model it participates on both its weight class and the open class