“Only you can know what colour you see”. But if it is true that only you can know, you can't ever import this knowledge, nor can you express it.
     Why shouldn't we say that I know better than you what colour you see if you say the wrong word & I can make you agree to my word, or if you point to the wrong sample etc.?