Generally, no. If the channels are themed tightly, it should give you a good idea of where to look. It also helps make it easier to filter in Slack's search. If you need to reference the conversation later, it should probably be linked to in documentation/project management tool. If you need it for your own personal needs, you can bookmark/star it.
I can't find the article that I read, but someone mentioned that it's beneficial to have different communication tools for short-term and long-term memory. Slack is great for quick, one off conversations. At the point that you find yourself discussing a larger issue and coming to a decision with long-lasting impacts... or needing to refer back to information frequently... the information should no longer be living in a chat application.