I overheard someone ordering a "flat white" the other day. All I could think of to meet this description, apart from paint, was Ally McBeal. Not remembering the actress's name, I searched and determined that it was Calista Flockhart, that she is married to Harrison Ford, and that they have an adopted son named Liam.
The search offered a drop-down to answer the burning already answered question about whether Liam was adopted. Unable to resist, I took the bait. The "AI" answer included this hallucinated statement: "Harrison and Calista began dating Liam when he was around eight months old, and they have been together ever since."
Not always. My first assignment at a new job (realtime embedded, safety critical) was to join a code review on a piece of software that needed to run at millisecond rates.
The code was written by a moderately experienced person whose previous experience was in aerospace ground systems in FORTRAN. This was C code for a very tightly constrained device, 8 bit microprocessor, with a fairly rudimentary compiler. The code being reviewed was array-rich and looked a lot like FORTRAN.
I did a BOTEC calculation very late the night before the review, and determined that the code was far from being able to meet the realtime requirements. At an opportune moment about 2/3 through the scheduled time, I raised my hand and presented my analysis. The meeting collapsed into 4 people and a blackboard.
It took the best developer in the company (and with direct experience in the specific problem domain, which I lacked) a full year to implement and verify the task in a mixture of C and carefully hand-tuned assembly ISR code.
It can be argued that this should have happened earlier at a design review. I was not there at design time, but perhaps the fact that I was not yet in the project cultural momentum, was an advantage toward skepticism. That advantage might be shared by automation, but how much would automation know about the specific problem domain, processor, and compiler capabilities?
The moving cursor writes, and having written, blinks on.