Something to consider is that entropy has units of measure. Why would a purely philosophical concept be given units of Joules per Kelvin?

I'm only reminded about this because, though I'm a physicist, I've been out of school for more than 3 decades, and decided that I owed myself a refresher on thermodynamics. This coincided with someone on HN recommending David Tong's textbook-quality lecture notes:

https://www.damtp.cam.ac.uk/user/tong/statphys.html

I think at least the first few pages are readable to a layperson, and address the issue of our imperfect knowledge of the precise configuration of a system containing, say, 1e23 particles.

But if we knew all of those relationships, the system would still have entropy.