Home/ Questions/Q 7444235
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-29T11:28:11+00:00

I am interested in using CUDA to program a multi-GPU application. As far as

  • 0

I am interested in using CUDA to program a multi-GPU application.

As far as I know, one can use multiple GPU’s to execute 2 or more kernels execute simultaneously in parallel. Each kernel’s data resides on the GPU it is executing on.

But what if I want my data and kernel operation to span several cards. How does one do this?

The simpleMultiGPU example in the CUDA SDK is not what I want since it basically launches the same kernel on multiple GPUs. No inter GPU communication is present, which is what I am interested in.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    It sounds like you’re interested in Unified Virtual Addressing (UVA) and P2P communication. Consult http://developer.download.nvidia.com/CUDA/training/cuda_webinars_GPUDirect_uva.pdf . You should not be communicating between different CUDA blocks anyway, but the techniques I mention should at least allow you to read data and write data across multiple GPUs, access the data in more flexible ways.

    • 0