I'll be the first to admit I have terrible taste in music. lol I even like that NIN song you quoted!! My husband is constantly asking why and how he ever married me (jokingly, of course...haha).
Heck, I adore Broken; Wish and Last especially. And even Suck ever since Trent leaned down over me and sang the entire second verse staring me in the eyes when I saw them live once. And Physical is... Yum. I even think that he's managed some great lyrics throughout his career, but that line and the one in The Only Time about "the Devil wants to f*** me in the back of his car" makes me crack up.
And I have some things I like that many things would deem terrible taste too. For example, I still enjoy the Transvision Vamp Album I got at 16, not to mention all my old Indochine records. But that is still Good Music, just like a party band like Eagles of Death Metal can be Good Music (Very Good even) so I'm not ashamed.