agree, that makes it a bit tricky to compare (esp if you also want to add different models and reasoning levels into the mix)

I will add more tasks (esp longer ones) and think more about grading, the current tasks were easy to grade because the desired outcomes are well specced but I will also look into more open ended tasks and how to grade those

thank you!