At the 70th Annual Golden Globe Awards in Beverly Hills Jan. 13, co-host Tina Fey jokingly told nominee Taylor Swift to steer clear of Michael J. Fox's son, Sam, who was serving as this year's Mr. Golden Globe. Though the bit elicited big laughs from the audience, the Spin City star shares Fey's sentiments.

New York Magazine's Vulture caught up with Michael, 51, at a book party for Ann Leary's The Good House Jan. 16. "I don't keep up with it at all," the Back to the Future actor admitted. "Taylor Swift writes songs about everybody she goes out with, right? What a way to build a career."

If Swift, 22, were to ever pop up at a Fox family dinner, the actor wouldn't be too concerned at first. "I wouldn't even know who she was," explained Michael, who has been married to actress Tracy Pollan since 1988.

Of course, Michael (who has three other children with Pollan) would be more likely to remember Swift if she penned a breakup anthem about Sam, 23. "'Sam, You Piece of Sh-t.' Oh . . . that was the girl you brought home!" Michael said.

Michael has reason to worry: In a 2010 interview with Us Weekly, Swift admitted her former flames often inspire her No. 1 singles. "I've always lived by the theory that if a guy doesn't want me to write a bad song about him, he won't do bad things," she explained. "And he shouldn't, you know?"

Swift -- whose ex-boyfriends include Jake Gyllenhaal**, Taylor Lautner**, John Mayer**, Joe Jonas** and Conor Kennedy -- most recently split with One Direction's Harry Styles**. During a disastrous Caribbean vacation in early January, the country singer, 22, and the boy band member, 18, "had a fight," a source recently told Us. "This [breakup] is definitely going to be for good."

This article originally appeared on Usmagazine.com: Michael J. Fox Does Not Want Taylor Swift to Date His Son Sam