Yes, this is a tough case.  You should go and talk to your doctor about this.  Still, if it is only on these tests that your color vision seems to fail you, I can't see why you would not be allowed to fly.  They might even grant you a waiver anyways.  Like I suggested, you should probably go and talk to people who really know about this color blindess.  I am just offering my opinion that, despite your problem, I think you'll still be able to fly.