Comment Re:Meanwhile, back at the benchmarks (Score 1) 21
("It actually makes RAM needs worse" -> "MoEs actually make RAM needs worse")
Comment Re:Meanwhile, back at the benchmarks (Score 1) 21
It actually makes RAM needs worse than a dense model, for a given quality.
That said, inference techniques like FreeToken are improving MoE swapping performance, so it's not as bad as it once was. Honestly, I would not be at all surprised if we start doing training in a swap-aware manner, where expert cache misses count as loss and models can queue experts to start loading before they're needed. Could even train in two tiers of loading - RAM and disk. Wouldn't that be great? Could run multi-terabyte models on consumer hardware. Training would tend to tend to concentrate key logic and reasoning on small number of very active experts, mixed reasoning/knowledge on less common experts that are usually kept in RAM, and rarer knowledge on experts that usually remain on-disk until needed.
Comment Re: Meanwhile, back at the benchmarks (Score 1) 21
There are well known, reputable abliterators on HuggingFace.
Also, censorship usually (not always) is something you care about for chats, not agentic work.
A
Comment Re: Meanwhile, back at the benchmarks (Score 1) 21
It's big, but not good for its size. They're using tricks to pretend that they're better than they are. For example, compare the numbers that they list for the competion on DeepSWE up against the actual DeepSWE scores.
Not cool, Mistral.
Comment Re:Meanwhile, back at the benchmarks (Score 1) 21
Artificial Analysis is overrated, but yes, Mistral is playing fast and loose with their claims.
Comment It's always flattening management (Score -1) 13
I figured out the scam a while ago. The original purpose of management was to keep an eye on unions and prevent employees from unionizing. Seriously Google it.
America doesn't really have unions anymore so we don't really have management anymore. What you have are basically a handful of people to implement policy and then you have a shitload of line workers declared management for a variety of unpleasant reasons ranging from managers being exempt from overtime pay to using the manager title to get a lot more work out of someone for very little additional pay if any...
And every time it's layoff time they can jettison these "managers" and tell everyone they're just flattening the organization and making things more efficient so nobody starts poking around asking if the company is viable and if they should be selling off the stock.
It's also a very effective way to fire old people without getting sued for age discrimination. IBM fucking loves doing that and if you actually look at the history of their layoffs it's almost entirely age discrimination pretending to be efficiency
I am so tired of seeing the same fucking tricks work over and over and over again.
Comment Re:My watermark would work better (Score 1) 66
It takes one hell of a toll to try to do verbal exams 1:1 on students to evaluate them.
Nobody said "verbal exams 1:1".
The only thing that is required is that they be separated from their computers and their phones.
Comment I've gotten exclusive access to the AI source code (Score 0) 15
@echo off
if "%~1"=="" (
echo Usage: %~nx0 filename
exit/b 1
)
type "%~1"
Comment Wake me when they actually shift (Score 1, Interesting) 45
I'm not a admin so I don't actually run my own VMs but from talking to other admins there is nobody who has tools for doing the kind of deployments you need to do in a large Enterprise except for VMware. I mean the tools exist but you're going to spend so much money paying people to monkey around with them you might as well just paid VMware.
There is a video from a YouTuber called Linus tech tips. His actual tech tips tend to be pretty shit but he does have one good video where he spent a few weeks trying to get all the people in his business off Adobe software and quickly found that yes he could do it but the man hours and the pay he had to spend doing it exceeded the cost of the licenses.
That's what Big Data gets you. You know exactly how much you can screw everybody over. You leave absolutely nothing on the table. Basically a giant fuck you to Leviticus 19:10.
Comment Re:AI done foolishly (Score 1) 66
I don't disagree with any of that. I see a lot of LLM and agents being thrown at problems we used to have much more tailored tools for that did at least as good a job, while consuming a tiny and by some comparisons almost immeasurably small amount of compute resources.
You're not wrong, Word 6 on a 486 with less than handful of megabytes of memory was able to perform grammar checking on word doc. Now you need 10s of gigs of primary storage, perhaps as much as 50 gigs of secondary storage between the model and the office suite. How much better a job it actually does is disputable. The experience is different, and a no-knowledge user can get started immediately. There is value there in both aspects. I don't see people who get paid access thru and employer etc to claude, gpt, etc stop using it or ignore it.
You're asking a deeper question though, how does that no-knowledge user become someone who understands the system when the system is getting bigger all the time and the short term incentives to learn anything about it get smaller smaller. I don't know. There is a lot of scifi on the subject, dated from before 2020, so thinking without being colored by recent economic interests, probably worth reading.
Comment Re:Paywalled AI Marketing (Score 4, Interesting) 66
Nobody, I repeat, nobody who uses AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, especially OpenAI".
And nobody, I repeat, nobody who doesn't use AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, now that it'll be easier to see that what I did is made by AI."
It is not "an advertisement of the power of the technology". It's a regulation forced on them by the EU's AI Act, which neither companies nor users want.
Comment Be scared!!!! (Score -1, Troll) 10
Comment "why" is the real question (Score 1) 59
The articles do a good job of establishing "what" but a poor job of establishing or even speculating on "why", which I think is the deeper question. If as they measured, older hearts become younger in younger bodies, knowing why that happens may give us clues on longevity treatments.
But it seems like the only consideration is that this gives them more organs to choose from for transplants.
Comment Where is the popcorn (Score 2) 30
I love when the jackals start fighting each other..