Sure, but they could count bytes without being byte level tokens.

Can models introspect about the tokens that were passed to them?