Are you sure? The cold boot RAM usage is not of significant importance. You should check the RAM usage after using your system extensively and then closing all apps. My personal experience have been that after using KDE for few hours the RAM usage of plasmashell, krunner and kwin is way too much and it keep increasing. This is on stock KDE without any plugins etc.
And you need that 100MB of RAM that dearly? Hope you use dwm or something like that, but maybe the xserver is also too big.
TBH I do, ML stuff is making me barely swap doing conversions and such.