I just realised the "download" icons aren't meant to be "similar icons"... they allow you to download the one above. Doh!
I've re-tried the "remove user" one but uploaded an SVG instead of a PNG (so technically the resolution is unlimited). Uploaded it both circled and not circled.
Here are the results: https://imgur.com/a/OT8Spjt