("It actually makes RAM needs worse" -> "MoEs actually make RAM needs worse")

It actually makes RAM needs worse than a dense model, for a given quality.

That said, inference techniques like FreeToken are improving MoE swapping performance, so it's not as bad as it once was. Honestly, I would not be at all surprised if we start doing training in a swap-aware manner, where expert cache misses count as loss and models can queue experts to start loading before they're needed. Could even train in two tiers of loading - RAM and disk. Wouldn't that be great? Could run multi-terabyte models on consumer hardware. Training would tend to tend to concentrate key logic and reasoning on small number of very active experts, mixed reasoning/knowledge on less common experts that are usually kept in RAM, and rarer knowledge on experts that usually remain on-disk until needed.

There are well known, reputable abliterators on HuggingFace.

Also, censorship usually (not always) is something you care about for chats, not agentic work.

A .safetensors or .gguf model cannot run code unless you let it. No agentic framework = all it can do is write text. It can't hurt you directly. At worst, it can only lie to you.

It's big, but not good for its size. They're using tricks to pretend that they're better than they are. For example, compare the numbers that they list for the competion on DeepSWE up against the actual DeepSWE scores.

Not cool, Mistral.

Artificial Analysis is overrated, but yes, Mistral is playing fast and loose with their claims.

They've been doing this bullshit since the '70s and it always works. People hear it and think yeah fuck the manager is right?

I figured out the scam a while ago. The original purpose of management was to keep an eye on unions and prevent employees from unionizing. Seriously Google it.

America doesn't really have unions anymore so we don't really have management anymore. What you have are basically a handful of people to implement policy and then you have a shitload of line workers declared management for a variety of unpleasant reasons ranging from managers being exempt from overtime pay to using the manager title to get a lot more work out of someone for very little additional pay if any...

And every time it's layoff time they can jettison these "managers" and tell everyone they're just flattening the organization and making things more efficient so nobody starts poking around asking if the company is viable and if they should be selling off the stock.

It's also a very effective way to fire old people without getting sued for age discrimination. IBM fucking loves doing that and if you actually look at the history of their layoffs it's almost entirely age discrimination pretending to be efficiency

I am so tired of seeing the same fucking tricks work over and over and over again.

It takes one hell of a toll to try to do verbal exams 1:1 on students to evaluate them.

Nobody said "verbal exams 1:1".

The only thing that is required is that they be separated from their computers and their phones.

I have exclusive access to the source code capable of finding up to 400 defects in Java code, summary below.

@echo off
if "%~1"=="" (
echo Usage: %~nx0 filename
exit /b 1
)

type "%~1"

The difference is that if you pay people to monkey around with things, you get a non-revocable perpetual license to the result. With license rental, you get a perpetual bill. It's the same rent trap as individuals get stuck in but with less excuses.

Yes, and the reason is that they stupidly painted themselves into a corner and never thought about an exit strategy. Had they been thinking about the possibility that they might one day need to migrate from the beginning, it would be much cheaper to do so now.

That's the thing about painting yourself into a corner, a little better planning at the start can always avoid it with little to no additional effort.

Well, initial stupidity can come at a very high price.

Yes. Funny thing: There is a regulatory requirement here for any financial service provider here to have a cloud replacement strategy. That includes cloud providers. Would be a good thing for everybody to have that, but people are stupid, full of themselves and greedy.

VMware didn't do this in a vacuum. If they raise the prices that much it's because they have solid numbers that clearly indicate that their customers don't have anywhere to go.

I'm not a admin so I don't actually run my own VMs but from talking to other admins there is nobody who has tools for doing the kind of deployments you need to do in a large Enterprise except for VMware. I mean the tools exist but you're going to spend so much money paying people to monkey around with them you might as well just paid VMware.

There is a video from a YouTuber called Linus tech tips. His actual tech tips tend to be pretty shit but he does have one good video where he spent a few weeks trying to get all the people in his business off Adobe software and quickly found that yes he could do it but the man hours and the pay he had to spend doing it exceeded the cost of the licenses.

That's what Big Data gets you. You know exactly how much you can screw everybody over. You leave absolutely nothing on the table. Basically a giant fuck you to Leviticus 19:10.

I would have though that by now they are all gone. Probably those left are the ones that stupidly painted themselves into a corner and never thought about exist strategies.

Nobody, I repeat, nobody who uses AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, especially OpenAI".

And nobody, I repeat, nobody who doesn't use AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, now that it'll be easier to see that what I did is made by AI."

It is not "an advertisement of the power of the technology". It's a regulation forced on them by the EU's AI Act, which neither companies nor users want.