Also there is a 3rd kind of memory, which is thread local memory (sometimes implemented as texture memory). On GPUs you can get access to the cache as a pointer.
@OneRaynyDay I think you should spend a day looking at the pipeline from scratch. You will notice that the example I posted didn't use the double underscore. Although the annotation resembles the long and far pointers of darker times.
__near & __far
Although frankly, I've used __restrict so much I'm not offended by underscores