When yes and no or any of the words that indicate affirmative or negative are in the middle of a sentence, they are surrounded by commas.
...And, yes, he did accompany us the first time.
...He wasn't there, no, when I needed him.
...She stopped by to give us the news; but, no, she didn't add any details.
Happy punctuating!
Margie