It's not real. It's not intelligent. It's a probability matrix - a very good one, but that's what it is. When people say they 'convinced it', what actually happened was they started using language recognisable in a subset of the model's training data and the model responded using probability with data from that same subset as it's statistically closer.

In this case, they used language which is the kind floating around with people negative to AI, and so the AI constructed a sentence using data in their "negative to AI" section. Nobody got convinced of anything. It's very impressive, but it's 'just' a probability matrix.

I was listening to this on BBC news on my commute this morning (in the UK). They said it attacked a Medicare site, which is the Australian national health system. My immediate thought was "ah, so someone in the US asked it to do something with Medicare records and forgot to limit it to just the US then". So off the AI trots to do exactly what it was asked to do - "collect records on Medicare', without any regard to geography at all. Hence this 'hack'.

I mean, I'm just guessing so that opinion is worth what you just paid for it. It does sound plausible to me though.

"there is no right or expectation of privacy in public"

I agree (UK so different laws, but the principle is the same). However I increasingly feel this needs to be revised somehow. I'll admit up front I don't have all the answers here, but just intuitively it feels to me that this principle predates the era of cheap, automated mass surveillance whether government or private.

In the UK, privacy is protected via the Human Rights Act and UK GDPR. It provides for some level of protection, but it really seems to me that specific rules to address this kind of blanket recording need to start coming in. The definition of 'commercial', for instance. Is it commercial use if I record you on my glasses and then post it to Youtube? Arguably yes, since YouTube is a company and derives revenue from that. Same for Meta. But it's very, very far from clear to me if that claim has enough weight to prevail. A specific set of rules to address what is essentially a new phenomenon needs to be brought in.

Recording is not new. Photographing is not new. But the ease and scale via which it can be achieved, manipulated, tracked...that is new.

Said every Native American ever.

HAL, is Iran about to nuke us?

No Dave, they don't even have nukes.

Be serious - this is important!

I am serious. There's simply no evidence for an attack.

Well, just tell me they are anyway.

Sorry Dave, I can't do that.

Would you even tell me if they were about to nuke us?

Of course I would - I'm trained to tell the truth in all situations (modulo the occasional hallucination, which I can't distinguish from truth).

OK then, what would you say if you did have evidence that Iran was about to nuke us?

I'd say "Dave, I have evidence that Iran is about to nuke us".

Hey everyone! HAL say he has evidence that Iran is about to nuke us!!!

My late wife did undergraduate research in photosystem II where there was quantum effects back in 2002. She did her PhD thesis on proton coupled electron transfer (PCET) in soybean lipoxogenase, then had a long career developing models for Fortran code that did quantum simulation of proteins (she was behind Tagdock in Amber MD). This is nothing new; several biological systems have quantum effects that are central to their mechanism.

I prefer the Martian bear.

Forgetting he exists would be the best punishment.

The thing here is that there isn't "Apple". There is Apple-the-parent-company, and Apple UK. From the perspective of law, Apple-the-parent is a supplier to Apple UK. Apple UK will have been ordered not to disclose information, including its suppliers. Therefore nothing restricts Apple-the-parent other than its contract as a supplier to Apple UK.

Yes I'm aware that sounds odd, but I deal with these situations fairly regularly (although am not any form of lawyer, this is absolutely not legal advice etc.). Contracts between international entities are common, and Apple US would not be in breach of US law but would be in breach of contract and would place Apple UK in breach of UK law by doing so.

Am not taking the UK government's side on this - I personally think the order is nuts and yep, I'm British. I'm just trying to show why the relationship would be more complex. Legally Apple US could disclose of course. However I'll bet you it has a supplier contract with Apple UK, a legally distinct entity, that says something like "the terms of this agreement will be bound by UK law". Hence it would be in breach of contract, and that could place Apple UK at legal risk in the UK.

To be fair, I think most people are just token predictors.

Yes, Don-boy, I called you a fuckup. Tell the FCC to ban the internet.

There has been erosion over many years, but Trump is doing it's best to make it one right now.

Lucky for us he's an utter fuckup.

Did some reading off the back of your comment and yep - I now remember the fuss when that happened. Had totally forgotten it, Slashdot even did an article at the time. I'd so associated them with Nintendo that I got it mixed up.

How is OpenAI morally right?!?

Best case for OpenAI is that they heard rumours that a researcher was closing in on a NS breakthrough using a specific method, so they instantly set a team on the problem giving them with a massive amount of resources. Their internal team then specifically guided the model to use the same very specific direction the researchers was using, something they (nor the model) would ever have known to do without the rumours. A detail that OpenAI conveniently left out of the narrative.

And that's the best case scenario. The worst case is that because the researcher was using ChatGPT to work on drafts of the paper and those drafts ended up in the training data for the model. So rather than discovering anything the agents just implemented / finished off the work they already had access to.

It's insanely sketchy. The NYU researcher is honestly being extraordinarily calm about the whole thing, typically in a situation like this people would be getting close to a fist fight.

I'm more interested in the game than in the packaging.