honoring robots.txt is an informal courtesy, not international law.
Not breaking the law is just about the lowest bar you can set for an organization.
We can go lower
FYI, we're still not sure whether the scraped AI training datasets involve copyright infringement.
Not breaking the law is just about the lowest bar you can set for an organization.
We can go lower
FYI, we're still not sure whether the scraped AI training datasets involve copyright infringement.