Ah, didn't think of this. Some rogue militia group might try to use this LLM (or create their own LLM based on this work) to help them create biological weapons or to do a mass hacking the infrastructure of targeted country.

Wonder what safeguards Kolibri uses to prevent this? Or if they even can

I don't think that AI is as much of a boost to bioweapons as people think. Lab work doesn't get easier just because the experiment design part does.

You can simulate things.

Given enough smarts, you can simulate anything. Quantum AI is an active goal.

Chemical and biological warfare is hard. A cult in Japan created a mass casualty event using nerve gas. Which is the only somewhat "successful" terrorist WMD attack I know of. Knowledge of how to create these weapons isn't new. Guns and bombs are the most widely used terror weapons for a reason.

Enter LLMs to help through all those pesky hard parts.

The hard part is probably finding the lab equipment and chemicals without being noticed, and choosing not to use it to manufacture drugs instead which would be much more profitable

Intelligence was never the bottleneck tho

For terrorists it is tho. Four lions is basically a documentary. The only clever and creative terror attack happened 25 years ago.

Didn't Mexican cartels kidnap telco workers to build them separate infra? We expect terrorists to be less resourceful?

What's stopping them from using claude today? What could anyone possibly do to stop them from using open models? This line of thought seems like corporate/political/pr pandering more than a meaningful concern.