I think you're referring to a similarly named N64 game. This story is about a game played using the seeds of horse chestnut trees.

https://en.wikipedia.org/wiki/Conkers