There's no way that with speed listening or reading everything sticks equally as listening or reading a 1.0x speed multiplier. It may feel like you got more done, but in reality you did not. You're essentially fooling yourself, feeling like you accomplished more than you did.
I do the same, but with movies/series. I "watch" them on a second screen without being all the time focused to it. Except if its a really good movie/serie. But if it isn't a good one, why watch it in the first place?