> performance (relative to PG14) seems to get worse as work_mem increases and the ratio of table size to work_mem decreases

Do you have any source for this? This is the first time I've ever heard this and it seems contrary to everything I've read.