My wife and I got stopped for it once, but we got let off after a bit of apologising.
Funny thing is we have been busy telling our daughter (3) to only cross on a green man, then one day she said "but if there are no cars coming, you can cross when it is red." Turns out that was the priceless advice of my mother in law