Earned income has the highest tax rates. Most people who are familiar with the tax laws try to derive most of their income from portfolio (investments) and passive (real estate) income.
Which I think was his point. Contrary to what would seem morally reasonable, wealth tends to automatically go to those who already have it, not those who contribute most or have the greatest need.
Of course, the original statement should really be changed from "America Favors People Who Don't Work" to "Capitalism Favors People Who Don't Work (and have money already)". The clue's in the name, after all - it's not called Labourism.
They're the ones who are cleaning your toilets, harvesting your food and doing the jobs you don't want to do.
I don't think he was referring to them.