While I suppose in practice this is true, I don't think the 5th amendment would technically apply. By mentioning the gag order you are not incriminating yourself but rather committing a crime.
Technically speaking, you are only allowed to refuse to answer a question if you believe that answering will incriminate yourself.