[Bobafett]

You may just have the wrong source file :

http://www.nvidia.com/content/cuda/cuda-downloads.html

This is a good place to find the right version, they have bash files for all the different distro/cpu arch.

Also make sure you have the right GCC version and the corresponding kernel for the distro you are using.