You will literally build nothing but the most primitive of devices unless you accept black boxes. In fact I'd argue its one of humanities great strengths that we can build on top of the tools others have built, without having to understand them at the same level it took to develop them.
I have been able to build plenty of stuff with a pretty plain emacs + ghci for years...neither are black boxes. Except maybe my brain driving them.
They run on an operating system you probably don't know all the inner workings of.
And that runs on a chip with trillions of transistors.
Yeah so? Claude isn't an OS. It's the thing making my code. I don't want my codebase to be some bytecode adjacent thing that LLMs operate on.
So you stand upon a big pile of black boxes.
Black boxes aren't inherently bad. But if they don't have well defined mappings of inputs to outputs, they aren't good black boxes. That's the problem with Claude Code imo.
I'm not just talking about the user
Its not like anthropic can just set a breakpoint in the model and debug
not really. Most of the technology is not black box but something of a grey box. You usually choose to treat it as a black box because you want to focus on your problems/your customers but you can always focus on underlying technologies and improve them. Eg postgresql for me is a black box but if I really wanted or had need I could investigate how it works.
True, you can understand an ICE engine all the way down to the chemistry if you so chose. An LLM isn't even understood by its inventors so users have no chance to understand it even if they wanted to.
Those black boxes are usually deterministic.