Throttle and yoke aren't a vote of no confidence from aircraft manufacturers. Some modes of operation are suitable for autopilot and some are not.

Would it be a vote of no confidence in Full Self Flying?

No, it would be an acknowledgement of the lack of perfection in human systems so far.

I mean, they kinda are.

Airline pilots aren't supposed to take a nap, and there are occasionally articles about the various things that have gone wrong because the pilots weren't paying attention.