I never had that problem when I used ICQ, but I also had a fairly small buddylist composed of my close friends and a few random people.
Although, reflecting, getting random messages like "Hi I'm 18/female/canada here's my website check out my pix!!" was annoying as a motherfucker.