> This is in part because of the work by Google on the NVPTX LLVM back-end.<p>I'm one of the maintainers at Google of the LLVM NVPTX backend. Happy to answer questions about it.<p>As background, Nvidia's CUDA ("CUDA C++?") compiler, nvcc, uses a fork of LLVM as its backend. Clang can also compile CUDA code, using regular upstream LLVM as its backend. The relevant backend in LLVM was originally contributed by nvidia, but these days the team I'm on at Google is the main contributor.<p>I don't know much (okay, anything) about Julia except what I read in this blog post, but the dynamic specialization looks a lot like XLA, a JIT backend for TensorFlow that I work on. So that's cool; I'm happy to see this work.<p><i>Full debug information is not supported by the LLVM NVPTX back-end yet, so cuda-gdb will not work yet.</i><p>We'd love help with this. :)<p><i>Bounds-checked arrays are not supported yet, due to a bug [1] in the NVIDIA PTX compiler.</i> [0]<p>We ran into what appears to be the same issue [2] about a year and a half ago. nvidia is well aware of the issue, but I don't expect a fix except by upgrading to Volta hardware.<p>[0] <a href="https://julialang.org/blog/2017/03/cudanative" rel="nofollow">https://julialang.org/blog/2017/03/cudanative</a>
[1] <a href="https://github.com/JuliaGPU/CUDAnative.jl/issues/4" rel="nofollow">https://github.com/JuliaGPU/CUDAnative.jl/issues/4</a>
[2] <a href="https://bugs.llvm.org/show_bug.cgi?id=27738" rel="nofollow">https://bugs.llvm.org/show_bug.cgi?id=27738</a>