A Hudson Valley man was caught in the act of allegedly defacing a joint American/Israeli flag with spray paint, police said.