Sorry Doesn't Always Mean You Are Wrong