Hi, Brave engineer here,
It is true that there are currently less examples of negative boosts, but it is supported by Goggles thanks to the 'downrank' option.
For example:
$downrank,site=example.com
If you want to be stricter, you can also discard sites completely of course:
$discard,site=example.com
I hope that helps,