Forgot your password?
typodupeerror

Comment Re:Meanwhile, back at the benchmarks (Score 1) 21

It actually makes RAM needs worse than a dense model, for a given quality.

That said, inference techniques like FreeToken are improving MoE swapping performance, so it's not as bad as it once was. Honestly, I would not be at all surprised if we start doing training in a swap-aware manner, where expert cache misses count as loss and models can queue experts to start loading before they're needed. Could even train in two tiers of loading - RAM and disk. Wouldn't that be great? Could run multi-terabyte models on consumer hardware. Training would tend to tend to concentrate key logic and reasoning on small number of very active experts, mixed reasoning/knowledge on less common experts that are usually kept in RAM, and rarer knowledge on experts that usually remain on-disk until needed.

Comment Re: Meanwhile, back at the benchmarks (Score 1) 21

There are well known, reputable abliterators on HuggingFace.

Also, censorship usually (not always) is something you care about for chats, not agentic work.

A .safetensors or .gguf model cannot run code unless you let it. No agentic framework = all it can do is write text. It can't hurt you directly. At worst, it can only lie to you.

Comment Re: Threating to "shoot up" a police station (Score 1) 87

Is there any language in the Terms of Service / Terms of Use that declare that their service is a mandatory reporter?

I guarantee you that they gave themselves the right to review your input for any purpose and inform law enforcement if they feel the need. I haven't read the agreement, but I'd still bet money.

Comment What? (Score 1) 15

Initiative, Clearinghouse... What? Most of us don't even want to know whether those are programs or products, and certainly don't know now.

IBM is pretty bad at naming in general, their names really tell weird stories. And I say that as someone who used to work for them doing support for TME10, another beautifully named product.

Comment Re: Be scared!!!! (Score 0) 10

We do get a lot of weird cross signaling about the future, don't we? They cry about falling birth rates while making it less attractive than ever to try to raise children, complain that no one wants to join the military while making it a worse place to be -and what else are those unwanted children for? Certainly not for the jobs they're obsoleting with AI, but if you don't have a job you can't have health care or food aid. Unless you can find volunteer hours that is, so you can have health care but only if you work for nothing, welcome to our latest form of mass slavery.

Comment Re:Paywalled AI Marketing (Score 4, Interesting) 66

Nobody, I repeat, nobody who uses AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, especially OpenAI".

And nobody, I repeat, nobody who doesn't use AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, now that it'll be easier to see that what I did is made by AI."

It is not "an advertisement of the power of the technology". It's a regulation forced on them by the EU's AI Act, which neither companies nor users want.

Slashdot Top Deals

Civilization, as we know it, will end sometime this evening. See SYSNOTE tomorrow for more information.

Working...