Don't you need to add another verb for “I could have a banana” to work as past tense?

E.g. "I could have eaten" or "I could have had"

Edit: Oh wait, now I see it. Something like "I knew I could have a banana if I got hungry."