Yes. but for embarrassingly parallel tasks it barely matters.

The task the majority of people here care about (and which makes up a huge part of AI lab revenue these days) is collaborative coding with a single human which is not embarrassingly parallel.

I am aware. I was talking about HLE. Talking about how fast you can run through HLE in a serial manner is like talking about how how fast your non-simd single threaded cpu ray tracer is. Its simply not how any sensible person would tackle this problem.

[dead]

Maybe not embarrassingly parallel, but can be surprisingly parallel.