I have a difficult time dealing with the angry atheism as well. I try not to listen to the song "Dear God" much at all because I hate the lyrics, but the melody is so catchy that the song stays in my head way longer than I want it to.
There are certain songs I've liked such as "No Thugs In Our House," "Poor Skeleton Steps Out," and "The Mayor of Simpleton." I've grown to enjoy others on a deeper level after having read XTC: Song Stories. It gives some interesting insights to some of XTC's lyrics. The book also reveals that Andy Partridge received a lot of hate mail as a result of "Dear God." Also there were a few violent incidents for some of the radio stations who played that song.