Yeah, they gum up cellular workings. Kind of like how macro plastics will gum up turtle stomaches.
I have seen zero evidence that they are bad in very small quantities, but the dose can make the poison and they are out there in increasingly alarming quantities.