Well, he has been dabbling in rocketry too...

Funny how you haven't even mentioned Pascal as a possible unit :-)
(at least you do use bar, so perhaps there's still hope for you Americans...)

A Torr, how many libraries of congress per football pitch is that?

In The Culture humans are somehow still in charge. I don't think that's very likely

The problem is that Ai will become ubiquitous. Sure, today they still need so much processing power that they can't do everything, just like computers in the 1960s could not do everything. But pretty soon, once truly dedicated AI chips become available (not just glorified video cards with limited parallellism crunching a big database of weights, but actually structured like a neural net, currently in development), our phones will be able to produce entire original movies on demand. No human will be able to compete. Writing a book will be like hand made pottery or wine brewed in your basement, some people will appreciate it but it will be nothing more than a hobby. The state of the art will be 100% robot produced, and human endeavor will become irrelevant.

No, because those people can't do everything since they can't be everywhere at once and pursue all possible goals simultaneously. There will always be things for me to do that nobody else has. I read a great quote in this thread, saying that the woods would be very quiet if only the best birds would sing. In today's world, everybody can still sing their own song and be appreciated.

However, if there are masses of robots everywhere doing everything better than we can, it's a different story. They would be "singing" everywhere while we could barely utter an irrelevant little chirp.

Wow, you've put a lot of effort into these posts, Too bad they're so far down in the Slashdot threads so nobody else is participating, because you certainly do raise interesting points. Lots of stuff to think about, and I'll definitely give some of those books a try.

Some of your remarks make me more hopeful. I've also read several Iain Banks' Culture novels where humans and superintelligent AI work together just fine, but felt it hard to believe that humans are still somehow in charge in that universe.

The issue about "Acceleration of Addictiveness" is also a very real threat. I can already kind of see it in my kids when they're on their phones all day, imagine all of humanity not being required to work anymore with electronic distraction of all kinds available for free all the time...

I'm glad to see others are also thinking about these issues, because I've read a few books like "Superintelligence" and others, but they always seem to worry only about rogue AIs taking over by force without considering the threat of us simply becoming irrelevant in a gentle but unstoppable way.

It will take me some time to digest everything you wrote here, thanks for the time you put into it!

True, but what will be the purpose of humanity as a whole? The idea of being like rats in the subway living under a higher society of robots does not feel particularly appealing for me. Robots making our laws, judging us by those laws, and punishing us when we don't follow them, sounds like a dystopia but is exactly what we will move towards when AI turns out to be better at law making, better at unbiased judging, better at policing, etcetera. It won't make sense not to let them govern us.

As for purpose as individuals, even if you're not the best at anything, you can still make a difference today because those "best" people can't do everything. You can still be an important cog in the machine, do research, develop cures, make better products, etc, or simply do your job well. With AI running everything, none of that will make a difference anymore. There will only be hobbies, nothing of any importance done by humans. No big human projects, no Hollywood movies (why waste a billion dollars on something that can be dreamt up by AI for free?), nothing to be proud of. Nobody will even be able to say "I helped build that bridge". You can still write a book, but it will be a curiosity for friends and family because AI books will be unbeatable in the mass market. One page turner after another, as many as you like about any subject you like, perfectly tailored to human desires. Sure, some people will still prefer human written literature but the masses won't. And will we still bother to educate people so they're even capable of writing books at all? Who wants to spend so many years in school if it's basically pointless?

And then there's another worry: what will the AI do? Will it have a sense of purpose? Will it try to achieve great things? Or will it just descend into nihilism and take us with it?

People are often worried about AI taking over civilisation by force. While I agree that this is something we definitely should watch out for, I don't think it's the biggest risk we face. I think AI will take over not because it wants to take over by force, but simply because it won't make sense anymore for us to be in charge of anything.
AI is already running the stock market, pretty much. It will soon take over the entire fields of mathematics and physics. Just feed all our current math and physics into a powerful AI and it will solve the RIemann Hypothesis, the Theory of Everything, etcetera in a matter of minutes. In the beginning our top mathematicians will marvel at the elegance of the new proofs and theorems, but soon the AI output will be as incomprehensible to them as current top level mathematics is to an ordinary person in the street, totally incomprehensible gobbledygook. We'll just use the results and give up trying to understand.
At some point AI will start giving "suggestions" on how to run the economy, and then move on to other laws as well. The results will be incredible, we will absolutely love the new harmonious and prosperous society it creates and therefore allow it to go further and further, making all our decisions for us. Because countries that don't, will be left behind and soon change their minds.
Until we reach a point where AI is basically running everything and we are just enjoying ourselves without any control over our destiny.
That, imho, is the biggest risk we face and I can't think of any way to stop it from happening because every step of the way will seem like a good idea. Until we wake up and see that we are no longer in charge of anything and uncapable to stop it. Robots will reach for the stars (much easier for them without needing food or oxygen), they will no longer need us to build new bases and travel further and further. Hopefully they'll provide means for us to follow along, but that's far from certain because it takes so much effort to keep weak humans alive in space.
What will we do? What will be our purpose if robots can do everything better than we can? What achievements can we pursue, other than entertainment?

Yep, already messed up a couple of times, trying to change volume shortly after pressing the wiper button.

Also, the setting is displayed on the screen so you still need to look away to see what you're doing.

Voice control does work well, though.

Tesla does have physical controls (stalks or buttons) for indicators and wipers. (For the wipers, when you press the wiper button, the left scroll wheel controls wiper speed for a few seconds before reverting back to volume control)

When you press the wiper button (on the stalk in older vehicles, on the steering wheel on newer ones), the scroll wheel switches from volume control to wiper speed control for a few seconds. You can also use voice control.

The yoke and new steering wheel on Model S did indeed make the horn a touch button, although reportedly new models also have a horn in the center which had to be activated by a software update (not sure if that's happened yet).

The radio volume can be controlled with the left scroll wheel on the steering wheel/yoke.

I guess we'll just punish your brain, then.

They must have used a Neuralink then. Interesting feature.