Agents are the wrong paradigm entirely and have limited places where they actually belong.

Going off and searching the web isn't really it.

You need to create 'new worlds' where they can operate best - and even then constrain what it does.