proofs by counterexample are effective but ultimately unsatisfying. they get you to an answer but they don't help help you understand and bend you r mind into seeing how the math works and lead you on to the new set of questions.

and for now as long humans are going to judge of what counts as an elegant or illuminating proof, there's going to be work for human mathematicians

I would only agree partially. There are counterexamples that are not illustrative, but it is fairly common that in thinking about how to construct a counterexample you gain a more thorough understanding of the original problem and at least one fundamental issue which prevents the conjecture from being true.

Right; see Lakatos. In its roughest form, you study the structure of whatever counterexamples you find, add those as (negated) preconditions to your proposition, rinse and repeat until you have a true statement. If the proposition remains useful, you now have a new definition.

Counterexamples are literally the only way to show a "for all" statement is false. (Non-constructive proofs by contradiction work by showing a counterexample must exist.)

Also, 'brute-force' style attacks where one simply feeds the input into the computer and it yields a solution are nothing new and certainly predate LLMs: https://en.wikipedia.org/wiki/Euler%27s_sum_of_powers_conjec...

Hell, one could even go further into the past and refer to the thankless work of pre-computer era mathematicians who sweated over manual calculations in order to disprove various prime related conjectures: https://en.wikipedia.org/wiki/Mersenne_conjectures

You seem to have an objection to non-intutionist mathematics in general, a position that was once held by many an illustrious mathematician but is relatively fringe in the contemporary academic community. Mathematical facts don't have to be intellectually satisfying or make sense to you, the human, rather it is up to you to wrap your mind around discovered mathematical facts.

Are you thinking of proof by contradiction, which is rejected by constructionism?

[Dis]proof by counterexample is the most straightforward way to show a statement to be false. What better way is there to disprove a general statement like 'all x are y' than finding an 'x' that isn't 'y'?

It’s very straightforward, but it often doesn’t (and here didn’t) fully satisfy the curiosity that was embedded in the original problem. Why did the Jacobian conjecture seem to be true? Is there some underlying symmetry that’s very slightly broken? Or perhaps there’s all kinds of counterexamples, and the intuitive pattern is only real for certain kinds of functions which happen to predominate in our intuition. Then how should we adjust our intuitions to better capture the space of possible polynomial functions?

You, right now, have the ability to spend a few weeks studying the Jacobian conjecture and its counterexample and write up a blog post about what you think is special about this counterexample.

Those are all good questions, but I don't really understand what alternative you or the OP are looking for actually resolving an untrue conjecture, besides a counter example.

I would frame it differently. The existence of compact counterexamples to a true-seeming conjecture suggests that there’s some deeper understanding waiting to be discovered. Fuzz testing for theorems, if that makes sense. I hope mathematicians in 2036 will be able to explain in detail why the Jacobian conjecture was false and identify which similar, true conjectures the community’s intuition was pointing towards.

We can take a simpler example. Let's say someone conjectures that all linear maps are isomorphic if they have the same domain and codomain*. A counterexample is easy to find, but true insight would be to notice that all linear maps with the same domain and codomain that are not isomorphic map some non-zero elements to zero. That is much more interesting than just finding a counterexample. Although, that isn't to say that finding a counterexample is not very interesting.

*statements only apply to maps whose domain is finite-dimensional

I suspect an AI, possibly a successor to current LLMs, will achieve that by the early 2030s. It might help illuminate many mysteries in math and beyond for us all.

There are many cases where it's possible to prove that counterexamples must exist, without identifying a specific example. This kind of proof provides more insight into the problem than simply finding a counterexample.

Constructivists would surely disagree!

[deleted]

Isn't the fact that you now know that the conjecture is false a huge help? At least it will help convince people to look at the conjecture more closely, no?

The counterexample in the news cycle today helps better understand how the math works. I can't think of one that doesn't.

You could spend the rest of your life coming up with conjectures that look elegant but are ultimately false. Disproof by counterexample only works if it's false, and we shouldn't be satisfied with a false conjecture to begin with.

> and for now as long humans are going to judge of what counts as an elegant or illuminating proof, there's going to be work for human mathematicians

Considering ChatGPT was released only three and half years ago, and LLMs could do high school math only less than two years ago, I think this "for now" will not last very long.

> Considering ChatGPT was released only three and half years ago ...

Or are they approaching an asymptotic limit?

Elegance may not remain exclusively human forever but usefulness probably requires more than correctness

Not much worth in understanding a statement that is wrong and has been shown wrong.

Unless you want to spend time "proving" that 2 * 2 = 1.

Seems like a breakdown on the incentives / imperatives in the field? I hope that's not an over bold guess from a non-mathematician.

Couldn't people in principle continue to study a problem that's only been shown to break at one point? Prove something adjacent, or slightly weaker, or elaborate the counter example into a powerful explanatory framework?

Maybe I’m just not pure enough but I find the whole concept of proof by counterexample to be elegant, and I don’t see why proving that something must be true is superior to proving that it can’t be false.

It's elegant if all you're concerned with is whether a conjecture is true or false. Answered, move along!

But mathematics is not a collection of facts. Mathematics is the study of abstraction. And what do you learn from a single data point? What can you abstract from that?

That's why just being a counterexample isn't really interesting. There has to be more than "counterexample" for there to be something to abstract. Was it generated from an analysis of the problem? Can the counterexample be generalized to explore the problem further? Is the counterexample a surprise in a way that suggests something is missing from current understanding?

Being a counterexample doesn't mean that something isn't interesting to a mathematician. But it's also not the interesting part.

You’re smuggling in a frame here which isn’t obviously true: that mathematics is not just a collection of facts

You have a weird definition of "smuggling". I say it outright. Because I follow it up with a description of the actual practice of math: it's the study of abstraction. That's not a frame. That's just what math is.

I think the nature of mathematics is an interesting question without one clean answer. To present a radically different view of mathematics:

It's a game of string transformations, where the goal is to produce specific strings given a set of rules.

The (syntactically valid) strings would correspond to statements, a producible string a theorem, and the production the proof.

You mean proof by contradiction, which is something different.