I have had a strange black encrusting type sponge, very hard and slippery, overtake some polyps in the past.

I prefer my sponges as part of my filtration system, apart from my display tank.