The podcast features Coyne talking about the incoherence compatibilism, and how he thinks all of it is a semantic game. But he still feels that society should be punishing people per se for what they have done. Given that, I didn't think he'd say that. There's a lot in the podcast, I suggest you listen to it in due time.
Coyne: ". . .Yeah, and there's one other thing, which just struck me the other day when I was thinking about an old girlfriend I had and feeling regrets. And all of a sudden, like, intellect kicked in and I said, 'Well you know? What happened, happened. There was no choice about the matter. Why should I feel any regret? Why should I wish that things had turned out differently, they could not have not turned out differently.' "
Craig milks this to make a bit of polemic fairly enough.