He doesn't actually think you're lying. He's digging up something that you've previously done and is throwing it back at you as a subtle reminder of what he hasn't gotten over. Anyway, heres a tip: always wear what your mistress's lipstick color is. No retarded white shirt/red lipstick combination. Remember this and you should do fine.