Utilizing power of the modern GPUs is certainly impressive, however there is a serious limitation at this time.

While SSE vectoring unit could process a 8 double precision 64-/80-bit numbers at a time, GPU could process vectors of hundreds of numbers, but limited to the single 32-bit prescision.

Most of the established CPU demanding scientific applications will need douuble prescision. Only few problems are very well suited for lower prescision.