Comment Re:Fundamental physics has never been more dead (Score 1) 19
Sounds like Newton. Long tradition, I guess
Sounds like Newton. Long tradition, I guess
"Okay, nuclear power. Yeah. Yeah, they did give us that. That's true. "
"And industrial-scale superconducting magnets!"
"Don't forget GPS satellite relativistic corrections!"
"And radioisotope therapy!"
"Electron beam therapy?"
"World Wide Web, wasn't that created by particle physicists?"
"Yeah, they did do that."
"Capacitative touchscreens too, you know."
"All right, all right, FAIR ENOUGH! But APART from computers, telecommunications, nuclear power, PET scans, MRIs, satellite communications, superconductors, radioisotope therapy, electron beam therapy, heat-shrink tubing, cargo and baggage screening, smoke detectors, muon tomography, capacitative touchscreens, and the World Wide Web, WHAT HAS PARTICLE PHYSICS EVER DONE FOR US?!"
"Synchrotron light sources for drug discovery?"
"Oh, drug discovery?! GROW UP!"
Yeah, what has a better understanding of particle physics ever done for US, huh???
_
if this were true it would not be possible for the system to read the watermark.
You confuse "invisible to humans" with "invisible to statistical analysis". Humans can't, for example, see the difference between metameric colours. Statistical analysis can. Humans can't see minor drift at scales where Brownian motion dominates. Statistical analysis can. Humans can't see the difference between background disease rates and new rising threats. Statistical analysis can. On and on. Statistical analysis is a far more powerful tool than human perceptual abilities.
this is also a lie. Identical thoughts must be expressed identically, otherwise they are, in fact, *different* thoughts.
I literally gave an example above. If you saw "picked a mango", "selected and picked a mango", "from within the tree, picked a mango", you would never think there was anything going on in the choice, and it isn't going to change the story one iota.
("It actually makes RAM needs worse" -> "MoEs actually make RAM needs worse")
It actually makes RAM needs worse than a dense model, for a given quality.
That said, inference techniques like FreeToken are improving MoE swapping performance, so it's not as bad as it once was. Honestly, I would not be at all surprised if we start doing training in a swap-aware manner, where expert cache misses count as loss and models can queue experts to start loading before they're needed. Could even train in two tiers of loading - RAM and disk. Wouldn't that be great? Could run multi-terabyte models on consumer hardware. Training would tend to tend to concentrate key logic and reasoning on small number of very active experts, mixed reasoning/knowledge on less common experts that are usually kept in RAM, and rarer knowledge on experts that usually remain on-disk until needed.
There are well known, reputable abliterators on HuggingFace.
Also, censorship usually (not always) is something you care about for chats, not agentic work.
A
It's big, but not good for its size. They're using tricks to pretend that they're better than they are. For example, compare the numbers that they list for the competion on DeepSWE up against the actual DeepSWE scores.
Not cool, Mistral.
Artificial Analysis is overrated, but yes, Mistral is playing fast and loose with their claims.
The following was in my submission on the firehose, but the editors opted to remove it
Some of the key points, from the published article's summary:
Unfortunately, it seems that politicians and a good chunk of the public prefer Permanent DST.
It takes one hell of a toll to try to do verbal exams 1:1 on students to evaluate them.
Nobody said "verbal exams 1:1".
The only thing that is required is that they be separated from their computers and their phones.
Nobody, I repeat, nobody who uses AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, especially OpenAI".
And nobody, I repeat, nobody who doesn't use AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, now that it'll be easier to see that what I did is made by AI."
It is not "an advertisement of the power of the technology". It's a regulation forced on them by the EU's AI Act, which neither companies nor users want.
If you are an old guy with a failing heart, don't go for a heart transplant - go for a full body transplant.
Maybe just keep your brain and take the new head too, to avoid that wizened head on gen Z body look.
On a more serious note, maybe there is something to the blood boy thing? Is there an anti-aging treatment to be had?
I just need enough to tide me over until I need more. -- Bill Hoest