If it doesn't taste like hops or grain, it's a yeast flavor. At different temperatures it contributes different flavors. Banana and clove flavors are hallmarks of a hefe yeast, and are produced at relatively higher fermenting temperatures. The chemical categories are esters (the fruit flavors) and phenols (the spice flavors). Many esters are reminiscent of fruits because fruits in nature begin to ferment with the same yeast.
Beers are also sometimes fermented with organisms other than Saccharomyces. These organisms contribute a wide variety of flavors, generally funky or sour.
Many beers are unfiltered because the filtering process can remove other, desirable flavors (mostly hops). Filtering used to be very rare in American craft beer for this reason.