You're mistaken about the dearth of comets. We observe well over 50 new comets each YEAR since the era of modern astronomy. But the vast majority of those are short period comets originating in the Kuiper Belt - not the long period comets that would be knocked out of the Oort Cloud.