It's just going to string along a whole bunch of instructions from random tutorials that it ingested.
What's going to get interesting is in a few years those websites and forums that have been used to train the AI are going to dry up. GitHub is going to dry up too because a lot of the projects they are are from people either in college or putting together a portfolio to get a job and is just not going to be enough jobs for people to be bothered with either of those two things. Anyone going to college is either going to try to get an engineering degree, a math degree or more likely law or medicine. Maybe accounting.
Basically the training data is going to dry up.
I'm not sure it's going to matter that much when it happens. I could see companies just running with old technology that's already working and leaving it at that rather than hiring people or you know, having a functioning economy.
I have to admit I didn't expect to see capitalism destroyed by capitalists and billionaires. And in the worst way possible. Instead of fully automated space communism we're going to get a techno feudal hellscape dystopian.
Of course we're going to put idiots in charge of everything and keep the nuclear weapons around so you know, it's a problem that will solve itself. The only real question now is whether it's going to be the raccoons or the beavers that evolve in advance civilization after we're gone. Could be ferrets I suppose. All three of them are pretty close to having opposable thumbs I think.