Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror

Comment Re:say what? (Score 1) 62

I've written things in Java and in Swift, and you aren't going to see an 85% difference. Swift has a lot of its own weird verboseness going on.

In an extremely heavy allocate/free environment, GC in Java will take something like 10 minutes out of every hour. Which is significant, but you shouldn't see a 40% increase in throughput from that either.

Someone else suggested they were probably parsing JSON/XML repeatedly or something similar, which is possible considering 'parsing' is just a simple function call.

Comment Re:ChatGPT is not a chess engine (Score 1) 116

LLMs are mostly composed of regular old fully connected ANNs, and the remainder, the transformers, are also ANNs.

You're talking theoretical things here, not practical reality.

ANNs certainly can learn the rules of chess, and you can train one to play chess at a level that is generally regarded as superhuman.

No one has ever made an ANN that plays chess at a level that is superhuman. AlphaZero is still primarily a tree searching algorithm with an ANN used to evaluate every node of the tree.

There's also a proof that any 2+ layer ANN of sufficient size can learn any IO function.

To remove the tree search, the ANN would need to be VERY big.

The fact that they don't, or don't do so very well, means that the way they are trained is an inefficient way to learn chess.

LLMs are trained in an inefficient way to learn anything. How many billions of pages did you need to be trained how to read?

Comment Re:ChatGPT is not a chess engine (Score 1) 116

That's why it can do this at all. What is impressive is that it can do that even without the sort of specialized training you envision.

How many pages of chess instruction do you think ChatGPT has been trained on? How many pages do you think it would take for it to play a decent game of chess?

Comment Re:There's plenty of money to fix this (Score 1) 81

Usually into offshore accounts..

Usually not into offshore accounts. You are completely wrong here.

When someone buys stock, the money goes to whoever sells the stock. And they use it to buy something else.

No, they use it to make bad loans to sell off at a profit

What percentage of loans made by banks are bad? Show you can think.

Comment Re:ChatGPT is not a chess engine (Score 1) 116

It's like the clock problem on steroids. Not all the required positions are in the training set of images. With the clock, you can easily just increase the number of images in your training set. With the chess problem, you can do that to some degree, but there are more positions than planets in the universe, so you won't have enough disk space.

Chess is a problem where you need to be able to tell the machine "these are the rules" and have it follow them. Humans can do that, the LLM can't.

Slashdot Top Deals

No one gets sick on Wednesdays.

Working...