public repos don't have to be scraped or cralwed all over by bots right?

They should not, then again they are.