His friendship with the president dates back to a late-night encounter in a deli. Now he is a loyal envoy brokering the Gaza ceasefire and peace talks on Ukraine