Really interesting post. I ran into some of the limitations of working with tables and LLM's last year.
I experimented with an approach to use the llm to generate a bespoke transformation machine that uses an LLM to generate a series of transform steps to extracting key data from large data sets.
https://tombers.github.io/oblique-angles/ai/education/2025/0...