Should you ask your customers?

I think this is a yes. This gives you some insight into what is desired.

Should you listen to that feedback?

I think this depends. You may get some customers that have unreasonable expectations. I have recieved some enhancemnet requests that make sense, so I implemented them. I've also recieved requests for functions that were beyond the intended scope of the product and would be better met with other products. In those cases, I would be honest and tell them those thoughts. Granted this is FOSS.