How does this work?

Anthropic sends .gguf and a claude-serve binary?

GGUF is mostly a hobbyist format, but yeah I'd assume it's a big pile of tensors and and executable.