Comment An alignment problem is for natural intelligence (Score 2) 43
Open Source is always the way to go IMO. Just like it is to work for the people instead of against them, and to develop technologies for peace instead of for war.
Open AI looks like a good idea, hence the company's name. But Open AI is no longer Open, and tech companies are walking back on their pledges instead of acting upon them. It feels like the current state of capitalism creates incentives that does not align with the people's interests.
You want to fight climate change ? Internalize the costs of pollution. You want people to earn a living wage ? Tax the hell out of profits made by businesses paying people below a living wage. Want the working class to pay less taxes ? Have the people who make billions off their backs pay taxes.
If our current political and economic systems fail to create incentives to do the right things, only activists will do the right things. If you expect the people to do the right thing for the whole, make sure you don't incentivize against it. Our current reinforcement system give extra points to bad actors.