Forgot your password?
typodupeerror

Comment Re:What does HubSpit do again? (Score 1) 13

We use Hubspot. Here's what we use it for:

- the "live chat with support person" bubble on our web application
- single funnel for incoming/outgoing support tickets & support communications with our customers

Adopting it was an old decision.

We would love to not use hubspot; the service delivered vs. the ongoing costs seem like a bad deal now.

At some point, we'll get around to migrating to something else.

Comment Re:Meanwhile, back at the benchmarks (Score 1) 21

It actually makes RAM needs worse than a dense model, for a given quality.

That said, inference techniques like FreeToken are improving MoE swapping performance, so it's not as bad as it once was. Honestly, I would not be at all surprised if we start doing training in a swap-aware manner, where expert cache misses count as loss and models can queue experts to start loading before they're needed. Could even train in two tiers of loading - RAM and disk. Wouldn't that be great? Could run multi-terabyte models on consumer hardware. Training would tend to tend to concentrate key logic and reasoning on small number of very active experts, mixed reasoning/knowledge on less common experts that are usually kept in RAM, and rarer knowledge on experts that usually remain on-disk until needed.

Comment Re: Meanwhile, back at the benchmarks (Score 1) 21

There are well known, reputable abliterators on HuggingFace.

Also, censorship usually (not always) is something you care about for chats, not agentic work.

A .safetensors or .gguf model cannot run code unless you let it. No agentic framework = all it can do is write text. It can't hurt you directly. At worst, it can only lie to you.

Comment Re:Wake me when they actually shift (Score 2) 46

The bigger you are, the harder it is to turn the ship in an emergency. See Titanic.

At some point the inertia of change isn't worth it, as you suggested. It is possible, but is it worth it?

The last way to look at this is a way to start the process of diversifying our Tech holdings. Windows, Office, Adobe, VMWare etc. But here is my take, STEAM is showing the way out. We're not there yet, but the tide appears to be turning (to keep the nautical terms going).

Comment Re:Paywalled AI Marketing (Score 4, Interesting) 66

Nobody, I repeat, nobody who uses AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, especially OpenAI".

And nobody, I repeat, nobody who doesn't use AI is going to see "OpenAI adding watermarks" and think, "Oh, I better use AI more, now that it'll be easier to see that what I did is made by AI."

It is not "an advertisement of the power of the technology". It's a regulation forced on them by the EU's AI Act, which neither companies nor users want.

Comment Re:Rural populations mostly vote red (Republican) (Score 1) 52

Water usage is going to be highly dependant on your local climate. All the new AI data centres are direct liquid cooling so other than filling the cooling loops in the right location you will never need additional water. The problem is building them in hot places say Arizona, California etc. were especially in the summer you need water for evaporative cooling.
For example even in the UK you will need some evaporative cooling should you stupidly decided to put your AI data centre in the South of England. Come to Scotland and you can run free air cooling 24x7 every day of the year and have a really significant margin over the maximum daytime air temperature ever recorded.

Comment Re:My watermark would work better (Score 1) 66

Perhaps you should be realizing by now that homework is no longer a viable way to test how well students actually know the subject matter, and the only viable way to do so is in-class tests/exercises - frequent enough and worth enough of the grade to force them to study between lessons.

OR, alternatively, you could just keep doing what you're doing, and instead, in effect grade people on:

Comparably poor grades:
* People who actually do the work by hand
* "AI N00bs" who let stuff like that slip through

Comparably good grades:
* AI-experienced people who know enough to skim over the work, do multiple passes, or issue prompts that prevent such tells from getting into the work

Wherein, in effect, your net reward/punishment is inverted vs. what you should want it to be.

Closing one's eyes and ears to the fact that the environment students operate in has changed isn't an acceptable option. Education must adapt. And watermarks, BTW, will only catch "the n00bs"; more experienced / up to date students will keep track of what watermarks and what doesn't, and use AIs that don't watermark, or de-watermarking services.

Slashdot Top Deals

On a clear disk you can seek forever. -- P. Denning

Working...