Keeping an open mind about it, our understanding of physics is based on light-enabled observations, so if there is something that moves faster than light, we wouldn't be able to detect it anyway, yes?
You can hear things that are going faster than the speed of sound, so I don't see why something that is outrunning its own light would be invisible. You wouldn't see it coming, but you would see it leaving. If it's not transparent then you'd see its shadow, if it smashed its way through a planet you'd see the hole, etc.
You would actually see it departing both forward and backwards.
If there was something that moved faster than light, that still interacted with regular matter in some way, then yes, we would be able to detect it by the effects.
If it can have causal effects then we can detect it. If it can't, who cares.