Vectorizing the forward mode of ADOL-C on a GPU ... - Autodiff.org

Summary, Issues & Outlook.Summary, Issues & Outlook• GPU <strong>forward</strong> <strong>mode</strong> handily beats CPU based traceless and tracedcomputations in <strong>ADOL</strong>-C• CUDA implementation <strong>of</strong> <strong>forward</strong> <strong>mode</strong> is more or less straight<strong>forward</strong>• The user needs to concern <strong>the</strong>mselves with extra issues likedistribution <strong>of</strong> kernel function• Some GPUs have internal DRAM so data needs to be explicitlytransferred to and from it• CUDA provides cudaMalloc() and cudaMemcpy() routines for datatransfer• Several future development directions and questions open• second order derivatives• taylor polynomial propagation [distribution <strong>of</strong> threads? d-dimensionaloperations? concurrency?]• portability to o<strong>the</strong>r hardware [OpenCL? GLSL?]• GPU based trace interpreer [memory allocation for trace?]. K. Kulshreshtha, A. Koniaeva 13 / 13 <strong>Vectorizing</strong> <strong>ADOL</strong>-C using CUDA Euro AD 10.06.2013