Take homes are much lower signal now with AI

Depends on what you ask, i suppose. I’m sure i can come up with something that can’t simply be one shot or the result would be bad if you do. A bit more difficult on logistics tho as you’d have to arrange for an environment with some prepaid llm access

Without a way to estimate "AI power" used for the task I don't see how you can fairly rate home assignments.