Clarification. Duplicating multiple groups of layers in a "reasoning" loop
Normal:
L1 -> L2 -> L3 -> L4 -> out
Unrolled (current framing): L1 -> [L2->L3] -> [L2->L3] -> L4 -> out
Looped (proposed): --<--loop----
| |
L1 -> [L2->L3] x N --> L4 -> out
"reasoning loop"Note: ascii rendering HN is not trivial
The commenter "Skerit" below linked to a recent implementation of this:
https://ouro-llm.github.io/
See the left-hand side of the diagram here, which is your exact proposal:
https://ouro-llm.github.io/static/images/ouro_main.png