Jon Batiste and Stephen Colbert is a match made in musical comedy heaven and as you’ll see in Batiste’s Throwback Thursday post on Instagram, it has been this way for quite some time. Look for these two to do some dancing on Late Show beginning September 8 on CBS. 

Batiste also recently joined Colbert on his Late Show podcast to discuss musical and non-musical things. In one of the more heartfelt moments, Colbert explains why he picked Batiste to be the bandleader of his new late night show. After a lengthy pause, Colbert said, “The first night I met you when you were on the show, you called me out for having cards and not improvising and you didn’t know me. When you said ‘I like to improvise,’ you didn’t realize it but you gave me a really nice invitation to do what I like to do.” Colbert says for that night, he ditched the cards and did an improvised show. “As soon as that interview was over, I thought ‘damn, that’s a guy I could spend a few years on stage with.'”

The whole 26-minute interview is fascinating, as the two go back and forth about the unknown plunge they’re about to take together. They also dish on jazz, the “joy machine” and Batiste’s “love riots” that he stages at his gigs. Before you dig into that, though, watch them dance.