It seems like the problem is fixed by using an older graphics driver (9.17.10.2932). I tried changing inputs multiple times, at least 20, and it did not change colors. Usually the color change would have happened in the 2nd or 3rd try of changing inputs.
This is the GPU driver I was having problems with: 9.17.10.3071
and this is the older driver which I currently have installed that DOES NOT have the color change problem: 9.17.10.2932