I do cold brew in the summer too. If you hand grind it's not less time consuming since it uses more beans. If you have an electric grinder it's faster.
I am way too lazy to grind and don't want a dedicated appliance for it, so I just buy cheap pre-ground. I personally can't tell the difference between good and mediocre beans with cold brew.