This seminar provides an in-depth overview of the new GPU programming functionality in Mathematica 8 through CUDA. Topics include how to compile CUDA code into an executable, load user-defined CUDA functions into Mathematica, use CUDA memory handles to increase memory bandwidth, and use Mathematica parallel tools to compute on multiple GPUs either on the same machine or across networks, as well as a discussion about the general workflow of CUDA programming within Mathematica.