The Fed's decision was a very big surprise to most, from what I've read. Just google "taper surprise" to see for yourself. Also, this was a massive move upwards, so the argument is that over a billion dollars of bullish bets made at the exact same milliseconds is hard to explain away as another contrarian play that payed off well.
Still, skepticism is healthy, and it's possible that no scandal is involved.