This model has fast weights, which actually are modified during inference.
Marketplace for fast weights inbound
Marketplace for fast weights inbound