Comment Re:Unbalancing the arms race? (Score 3, Interesting) 85
In the short term. Right now the bad guys (well, non-state bad guys) don't have access to frontier models with the cyber security nanny mode disabled. However open source models are getting better every day and most don't have those guardrails, and even if they do it's not impossible to remove them when you have access to the weights. So yea, short term it's going to be an issue.
Long term, however, once this initial tsunami is worked through then hopefully more of these types of bugs will be found before new code ships, making it harder to find critical vulnerabilities in the wild.
Long term, however, once this initial tsunami is worked through then hopefully more of these types of bugs will be found before new code ships, making it harder to find critical vulnerabilities in the wild.