For me the convenience of “hey remember this fact” is outweighed by a desire not to get stuck in a search or context bubble.
It might be nice to have better UI to control which bits of history get added to the context of a chat, but then just use a coding harness instead of web UI