Question

I’m trying to check inside the shader (GLSL) if my vec4 is NULL. I need this for several reasons, mostly to get specific graphics cards compatible, since some of them pass a previous color in gl_FragColor, and some don’t (providing a null vec4 that needs to be overwritten).
Well, on a fairly new Mac, someone got this error:

java.lang.RuntimeException: Error creating shader: ERROR: 0:107: '==' does not operate on 'vec4' and 'int'
ERROR: 0:208: '!=' does not operate on 'mat3' and 'int'

This is my code in the fragment shader:

void main()
{
    if(gl_FragColor == 0) gl_FragColor = vec4(0.0, 0.0, 0.0, 0.0); //Line 107
    vec4 newColor = vec4(0.0, 0.0, 0.0, 0.0);

    [...]

    if(inverseViewMatrix != 0) //Line 208
    {
        [do stuff with it; though I can replace this NULL check with a boolean]
    }

    [...]

    gl_FragColor.rgb = mix(gl_FragColor.rgb, newColor.rgb, newColor.a);
    gl_FragColor.a += newColor.a; 
}

As you can see, I do a 0/NULL check for gl_FragColor at the start, because some graphics cards pass valuable information there, but some don’t. Now, on that special mac, it didn’t work. I did some research, but couldn’t find any information on how to do a proper NULL check in GLSL. Is there even one, or do I really need to make separate shaders here?

Answer 1

All variables meant for reading, i.e. input variables always deliver sensible values. Being an output variable, gl_FragColor is not one of these variables!

In this code

void main()
{
    if(gl_FragColor == 0) gl_FragColor = vec4(0.0, 0.0, 0.0, 0.0); //Line 107
    vec4 newColor = vec4(0.0, 0.0, 0.0, 0.0);

The very first thing you do is reading from gl_FragColor. The GLSL specification clearly states, that the value of an output varialbe as gl_FragColoris, is undefined when the fragment shader stage is entered (point 1):

The value of an output variable will be undefined in any of the three following cases:

1. At the beginning of execution.
2. At each synchronization point, unless
   • the value was well-defined after the previous synchronization
     point and was not written by any invocation since, or
   • the value was written by exactly one shader invocation since the
     previous synchronization point, or
   • the value was written by multiple shader invocations since the
     previous synchronization point, and the last write performed
     by all such invocations wrote the same value.
3. When read by a shader invocation, if
   • the value was undefined at the previous synchronization
     point and has not been writen by the same shader invocation since, or
   • the output variable is written to by any other shader
     invocation between the previous and next synchronization points,
     even if that assignment occurs in code following the read.

Only after an element of an output variable has been written to for the first time its value is defined. So the whole thing you do there makes no sense. That it “didn’t work” is completely permissible and an error on your end.

You’re invoking undefined behaviour and technically it would be permissible for your computer to become sentinent, chase you down the street and erase all of your data as an alternative reaction to this.

---

In GLSL a vec4 is a regular datatype just like int. It’s not some sort of pointer to an array which could be a null pointer. At best it has some default value that’s not being overwritten by a call to glUniform.