Where did it go

In a discussion with a lady last week about {gasp} politics, I brought out the point that clarified, per our discussion, 'to each their own'. I merely added the words 'To each their own so long as it does not violate others'. The kind lady said 'well, that goes without saying.'

My reply, 'If it goes without saying. . . it usually goes quickly.'