Exploring compression algorithms for weights is a good idea, and I hope you have a successful product. However, if you can prove this statement:
> reduces it down to its minimum entropy -- it cannot be compressed further.
I think you could make a lot more money elsewhere :-)
https://en.wikipedia.org/wiki/Kolmogorov_complexity#Formal_p...
We're not an AI company ... nor do we have any reason to use it. Just a fun idea that was fruitful.
And to clarify -- it only applies to models, not arbitrary data. So its useful to exactly zero other fields.