I've been using Claude Science a lot and it is VERY good at finding patterns in the DNA around my binding sites - quite often it went 'you could put your primer here but that looks like an Alu repeat, so better not, the primer won't be specific' - it seems like the press release is one step above that pattern recognition? I.e., 'there's a recurring motif here that hasn't been described before', which is probably straightforward to pick up when your context window is 1 million tokens, i.e. within the range of entire bacterial genomes...
Isn't finding this out from an LLM somewhat... complex and non reproducible.
Yep :) it's VERY non-reproducible - but I haven't asked it to look for Alu repeats in the first place, I can then go and reproduce the work it's doing
Do you find it a big improvement over the tools you used previously?
It's honestly harder - you have to do a lot of extra work to ensure your work is traceable. It's super fast in doing things you have no overview of - it makes pretty figures, it runs command line jobs etc. and I'm sure there are mistakes in there. For now I'm pretending Claude Science is an IDE, like Positron/VSCode, and I have to keep enforcing proper git usage etc. so I can reproduce this work