No, most people do NOT agree with that. Maybe most people in your circle of friends, but not most Americans at least.
The problem IS the loans. You loan 100k to an 18 year old who doesn't have the understanding of the long term ramification. The colleges love it because it is easy money for them. Little Johnny gets a degree in Women's Studies and doesn't understand that he has to pay the loan back, even though he has a job as a waiter. Some kids have it together, most have been so utterly coddled for so long, they've never had a job and simply can't comprehend the numbers they are dealing with.
The solution is to stop government funding of loans, which will lower the price of college (they will hate this), and MORE privately owned education choices, not fewer. Half the kids are getting degrees in crap that will not provide them a career in ANYTHING. The colleges don't care, they get paid regardless.