I've never had my birdsnest keep its polyps retracted for more than a few minutes that I've noticed, and always from something physically disturbing it.

I use an ATO so I never get a very large top off at once. How much did you need to top off? How often do you top off? I'd guess that if it was a sudden and large enough change in sg, that could do it.