That ain't the same thing.

This thing is doing things you didn't tell it to. It might even do things you explicitly told it to not do. It is not a case of "well, you could've forseen this as a consequence if you had been careful" like your campfire. My example is only a bit silly, it is absolutely possible that an AI agent will decide to hack NASA because you asked it for some data for a school project. Even in the broadest possible sense, that does not fall into stuff that the law so far has considered to be in the domain of negliegence.

AI agents do stuff you could not possibly have expected. Heck, I asked Claude a fairly simple knowledge question yesterday and it wanted to read from /dev/null. There is no argument you can make that would convince a jury that I should in any way have expected that and taken precautions. In a hypothetical world where a read from /dev/null randomly kills a puppy somewhere on the planet, I don't think I would've been convicted.

You don't get it.

Autonomous AI agents are the perfect no-responsibility card. The AI companies? They trained a general-purpose model and never gave it any explicit instructions to do hacking. The AI services? They are just middlemen and have no control over what people tell the agents to do. The people prompting the agents? Unless you're straighforward dumb, you didn't tell it to do hacking, you just told it something innocent like "find me all data on Mars for my school project" and the agent decided that probably NASA is hiding something so let's hack them to get it.

Since there's no human anywhere executing anything that's a crime - voila, in addition to the victimless crime we now have the perpetratorless crime.

A resounding success. No large-scale demonstrations, damaged cameras, lawsuits or political suicide for those involved. So we can expect this to be rolled out fully.

Crime prevention? Who said this has anything to do with crime?

I just wanted to let you know that you have successfully driven me off of /., after some 25 years.

Not just you, obviously, the site has been in steep decline for a long time, but you were such a huge asshole that you managed to be the last straw. So, congrats for that. I won't be back.

Yes, limited local AI models certainly are going to be a standard feature in the future.

I run both local and cloud AI. There is still a huge difference, because my local machine has to use smaller and quantized models. It takes considerably longer for lower quality results.

local LLMs aren't there yet and probably won't for the forseable future for ordinary people. If you want to run a full model like DeepSeek v4.1 Flash, you need something like half a TB of RAM.

The open-source LLMs are a different threat: They enable a service industry independent of the large players. I could today get some venture capital, rent a few racks in a hosting center, install a bunch of beefy machines and offer the same service as Claude or ChatGPT, just on an open-source model. The differences in benchmarks are becoming irrelevant for 95% of common use cases. And if I can offer that service for $19/m while OpenAI wants $29/m then OpenAI has a problem.

And IMHO this is the chinese strategy: Undermine the US AI industry by breaking its business model.

Has everyone gone insane or are we witnessing a major PsyOps ?

Since AI isn't magical, for it to be able to "kill all humans", it would have to be able to acquire the means to do so. Which means that these already exist. It means someone is able to do it right now. And we're chill with that, but worried about AI?

No doubt a bunch of autonomous weapon systems linked into a C&C could cause considerable bloodshed. Given that most of the existing weapon systems of that kind are essentially suicide drones, it'll still be limited damage.

Human-killing virus? Still need a means of creating and delivering it.
Nuclear war? We have humans in the loop.
Drive us all insane with AI-slop TikToks? A few percent of humanity still don't use that.

So what is the actual scenario ? When someone shouts "AI will kill us all", why don't we ask them "how, exactly" ?

More like 99.99%. Maybe need some more nines in there. Large C codebases without regular critical CVEs are basically nonexistent.

What bankruptcy-prevention actions are they asking for?

15-25 kWh drawn by the utility is quite a bit! I hope they're paying him well for that.

They're bringing outside scrutiny into their processes; that's going to slow them down, too.

Not "at the same time". You're conflating what AI can do now with what it will likely be able to do in a year or five, or 20.

Amodei and others are worried about what AI that doesn't yet exist may do, not about what current-generation AI can do. AI is getting better, very quickly, and unless there's some blocking obstacle that no one has been able to identify will at some point become far, far smarter than humans, individually or collectively. So before that happens, we need to figure out how to make sure that superintelligent AI wants to help us, and wants to do it in the right way.

Considerably more difficult than you imagine. Between them, they have almost 70 command-line options or flags. Taking into account that many of those behave differently depending on the presence or absence of other flags, there's a couple hundred different code paths. Then you need to handle directories, files, sparse files, sym- and hard-links, on and across different filesystems, not to mention the various file-like things scattered around (pipes, streams, etc.)

It's not rocket science, but neither is it trivial.

We knew that. But now we have proof.

Will anything happen because of that? Nah, I don't think so. A few token gestures maybe. A friendly mail to everyone saying to write better reasons, followed up by an informal mail that tells them to ignore the previous one.

This isn't a mistake. It's intentional. The more arbitrary and uncontrolled the police can act, the more it is feared, the more it is a tool for oppression and not a part of civil society, the more likely the cops will stand on the side of the powerful when there are protests or uprisings against the increasing oppression and economic divide.