Top AI researchers like Geoffrey Hinton say that large language models likely have an internal world model and aren't just stochastic parrots. Which means they can do more than just repeating strings from the training distribution.

Facilities are a major hurdle for nuclear weapons. For bioweapons they are much less of a problem. The main constraint is competency.