Silicon dioxide is not chemically toxic. But you can put microfiber crystals of it in a mammal's lungs and get tumors that grow around them. It is not a huge stretch of the imagination from there to hypothesize that nano- and micro-particles of a nontoxic polymer could also cause problems.