A BSc prepares you for any kind of specialization, including scientific programming and computer graphics. (Want to render fur or smoke? That's differential equations.) Bear in mind that many of your fellow students don't know yet what they will specialize in, or even don't grasp all the options. Exposing you to higher math shows you what those options can be. It's good to know what else is out there, because you will certainly get in touch with other fields through collaborations or a career change.
If on the other hand you even have trouble with algebra (which I count as beyond long division), CS as a whole may not be the right thing for you.