Question

I’ve been playing with OpenCL recently, and I’m able to write simple kernels that use only global memory. Now I’d like to start using local memory, but I can’t seem to figure out how to use get_local_size() and get_local_id() to compute one “chunk” of output at a time.

For example, let’s say I wanted to convert Apple’s OpenCL Hello World example kernel to something the uses local memory. How would you do it? Here’s the original kernel source:

__kernel square(
    __global float *input,
    __global float *output,
    const unsigned int count)
{
    int i = get_global_id(0);
    if (i < count)
        output[i] = input[i] * input[i];
}

If this example can’t easily be converted into something that shows how to make use of local memory, any other simple example will do.

Answer 1

Check out the samples in the NVIDIA or AMD SDKs, they should point you in the right direction. Matrix transpose would use local memory for example.

Using your squaring kernel, you could stage the data in an intermediate buffer. Remember to pass in the additional parameter.

__kernel square(
    __global float *input,
    __global float *output,
    __local float *temp,
    const unsigned int count)
{
    int gtid = get_global_id(0);
    int ltid = get_local_id(0);
    if (gtid < count)
    {
        temp[ltid] = input[gtid];
        // if the threads were reading data from other threads, then we would
        // want a barrier here to ensure the write completes before the read
        output[gtid] =  temp[ltid] * temp[ltid];
    }
}