It all become clearer if you replace it in your head by
"cache sizes oblivious" algorithms.
"cache sizes oblivious" algorithms.
No matter how you prefix it, 'oblivious' means you are missing something you are expected to be responsible for. It is a word expressing negative sentiment.