You're attributing one thing - suspicion of a particular denomination - to something which it may not be related to. It may simply be due to how common a particular denomination is used in the cash economy.
In the Eurozone, €50 notes are very frequently used - it would be unusual to be specifically suspicious of that denomination - while €100 notes are far more rare.