Reminds me of a story I read of a "learning AI" system designed for the army to recognize tanks in the battlefield - trained with lots of photos of Salisbury plain on a day when there were tank exercises against a set of photos of idectical locations on a day with no tanks present. AI system seemed to learn to detect tanks with high level of accuracy - however when they tried it on a live demo it was hopeless. After investigation they realized the day they took photos with tanks was sunny and the day without was overcast so the system had actually learnt to detect presence of clouds
Biting the hand that feeds IT
