Comedian Jo Koy has spoken about that Taylor Swift joke he made at the Golden Globes on Sunday night.

Koy took a swipe at the NFL for its new obsession with the pop sensation while hosting the awards that many found to be in poor taste.

“The big difference between the Golden Globes and the NFL? At the Golden Globes, we have fewer camera shots of Taylor Swift,” he quipped.

Taylor was not at all amused and took a sip from her drink while offering a cold stare. Koy has also taken lots of heat for the joke, which he insists was aimed at the league and not so much at Swift.

We live in an age where comedians can get slapped for making fun of women wearing green while at award shows. Koy was really tempting fate there.

“I think it was the Taylor [Swift] one [that] was just a little flat… It was a weird joke, I guess,” he said during an appearance on Good Morning America on Monday (H/T Thespun.com). “But it was more on the NFL… I was trying to make fun of the NFL using cutaways and how the Globes didn’t have to do that. It was more of a jab toward the NFL, but it just didn’t come out that way.”

Meanwhile, the NFL’s cameras will be getting plenty of Taylor Swift this Saturday as the Chiefs are playing the Dolphins in the Wild Card Round.