>Gettier's conception of knowledge as justified true belief (prob familiar to many philosophy undergraduates) implies that machines can't in fact accrue knowledge.
Nothing about the conception of knowledge as "justified true belief" implies that machines can't accrue knowledge.
For that to be the case "belief" would have to be defined in a circular way to exclude machines (which we can reject), or "justified" would have to be restricted to mean "based of observation of the external world".
The more general "based on observation of their input" applies to both men and LLMs.
That man can't know the bare direct facts of the world, just his own input (it's sensory experiences, and whatever second hand input he's given by other people), and for neither can he be sure they're absolutely true, or that he got right.
>The idea that knowledge can't be defined in a non-circular way is only plausible for someone with no familiarity with epistemology.
The idea that this or that epistemology restricts what can be the case in reality is only plausible for someone with no familiarity with epistemology.
> Nothing about the conception of knowledge as "justified true belief" implies that machines can't accrue knowledge.
They can't accrue knowledge because they stop learning once their training is finished.
That's an imposed limitation, nothing structural. The models do accrue knowledge during training so they already check that box. The LLM companies simply set it up such that newly gained knowledge can't be accrued after that, they could allow it just as easily.
Humans stop learning once their training is finished too, it's called death.
The difference is that LLMs we can talk to them when they're in that dead state.
And of course for an LLM this is an implementation detail. One could just as well keep updating the weights of the same model over time. And its being done, it's called "continual learning". LoRA is also a way of doing that.
By this definition if they could instead buffer recent facts and then offload to their weights reliably and efficiently they would be able to accrue knowledge despite their substrate.
Yes, and they'd have to deal with the same problem that we do: how do we know what is true? what gets counted as a "recent fact" and what gets dismissed as mere opinion or disinformation?
In training they get feedback. Out of training, not so much.
Hard problem
You mean they don't accrue knowledge during the training?