I heard about burn [1] and candle [2] recently and they sounded interesting.

[1] https://crates.io/crates/burn

[2] https://github.com/huggingface/candle

Interestingly, burn supports candle as a backend.