Thank you! Yeah, it is surprising how magic words can impact the performance of LLMs

do you actually know or are you just guessing

Funny enough we added this in awhile back when it seemed more conclusive that this does matter.

But I was curious and just did an adhoc eval.

Here's a version with the aesthetic line included

https://with-aes.vercel.app/

Here's a version without the line

https://wo-aes.vercel.app/

Everything else is the same. Will let y'all be the judge which is better.

Both where made in one-shot with this prompt:

Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages.

hard to try bc with-aes has a login wall lol

Agreed. It is curious how the agent got nudged to add auth in that one.

I did another ad-hoc but this time I added "Use guest auth" to the prompt. This way you don't need to enter an email. Full prompt below

Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages. Use guest auth

Aesthetic version: https://with-aes-guest-auth.vercel.app/

Non-aesthetic version: https://wo-aes-guest-auth.vercel.app/

I'd give the edge to the aesthetic one.