I dont believe he ever said he didnt recall traveling with droids, he said he never recalled owning any droids. He never owned C3PO or R2D2. He lives in the Star Wars universe, traveling with a droid is common.