Amazon runs anthropic models in it's own DCs with Bedrock.
How does this work?
Anthropic sends .gguf and a claude-serve binary?
GGUF is mostly a hobbyist format, but yeah I'd assume it's a big pile of tensors and and executable.
How does this work?
Anthropic sends .gguf and a claude-serve binary?
GGUF is mostly a hobbyist format, but yeah I'd assume it's a big pile of tensors and and executable.