I built a similar idea as a hobby project to see what was possible with harnesses. My idea was give a model a chat input, but outputs can be data models (sqlite), and panels that are custom react components that can be generated and mounted on the fly by the model.
The basic idea in todo list form was:
"Let's build a todo model to manage my daily tasks, then build a task list panel where i see today's todos."
It got more interesting from there as I kept building ontop of it. For example, I added data hooks (trigger something when data changes, e.g. custom code or even webhooks) and it felt like an AI native Airtable.
Everything persists and becomes the UI of the app itself.
Yeah I know people who think that chat is the last UI we'll ever need, but I really think there's so much that can be done with malleable interfaces.
I took it a step further with AI accessibility and recordings for teaching AI agents. Canvas context forms the who, what, when, where, and why, along with the agent conversation for training & agent maturity --- https://github.com/rush86999/atom/tree/main/docs/canvas
This is really cool! I'm glad there are others that had the same idea!
I prototyped mine early last year and models weren't quite where they are today. I'll try to find some time to update the code and release it.