Hi HN, I'm Mohan from Antigma Labs. Ante is a coding agent that ships as one self-contained ~15MB binary: the TUI, an embedded ripgrep, local PDF/OCR, and a natively managed llama.cpp engine are all inside. No runtime dependencies, no node_modules, no account.
- Ante installs a pinned, checksum-verified official llama.cpp build matched to your machine (Metal on Apple silicon; CUDA, Vulkan, or CPU on Linux) and handles upgrades when the pin changes. - It discovers GGUF files already on disk (~/.ante/models, the llama.cpp and Hugging Face caches), attaches to llama servers already running on local ports, and estimates RAM/VRAM from model size and context window before anything loads. - `ante --offline-model /path/to/model.gguf "prompt"` boots the server, runs the session, and shuts it down. `/offline-mode` does the same interactively; `ante serve --offline-model` loads a model once for many clients. - No API key, no account. Once the model is on disk, inference needs no network at all; set ANTE_TELEMETRY=off and no telemetry is exported either.
On capability, we'd rather publish the number than oversell: we benchmark local models with the same harness and auditable runs as frontier ones, and Qwen3.6 27B (a 17 GB download) scores 56.2% on Terminal-Bench 2.1 across 445 trials (live results: https://antigma.ai/eval). That's a real gap from frontier models. The design bet is that you mix: hosted providers and local live in the same catalog, `/providers` switches mid-session, so sensitive repos or high-volume work go local and hard problems go frontier.
Hosted models work with your own keys or subscription. But nothing about trying Ante requires signing up for anything: download the binary, point it at a GGUF.
Offline mode is under active development and has rough edges with the overview at https://ante.run/local/overview. I'll be in the comments.
Here you say:
But in README: May I suggest you use the first phrasing in both places. I took it as Ante devs had written their own engine and I doubt I'm the only one.there is one toy version https://github.com/AntigmaLabs/nanochat-rs README updated.
the public repo README is updated.
Not sure why this was dead but I vouched. It would be nice if telemetry was opt-in, otherwise this looks awesome and can't wait to try it!
will add those soon!
Where is the source code?
for now only some of core crates is migrated, will do so progressively
Why not make it Actually Portable Executable using Cosmopolitan Libc, like Llamafile, to make it run on Windows/Linux/MacOS? Why don't you support Windows with CUDA?
even with power of AI, we are mere human and still slow. Adding this to backlog.
Many people have slow computers, but for agent it is no problem. Only run LLM slow too.
yes. Offline mode is choice, should be able to run frontier one first and then figure out how do incorporate local models as real workhorse
Opt-out telemetry is a hard no for me, sorry.
Agreed! When a tool is explicitely marketed for offline use, opt-out telemetry feels especially contradictory. Should Definitely be opt-in by default...
Right? How hard is it to just ask a single opt-in question during installation. Opt-out just seems lazy, especially if I have to dig though configs to get to it.
feedback received, it was carry over from the preview dev build.
[dead]