[Fix] Fix the issue that single precision caculation is not runable on CUDA version

[Fix] Fix the issue that single precision caculation is not runable on CUDA version #5069