The brain is quite literally a neural network (in a more traditional sense of the word "neural"). A biological brain (especially a simple one) could probably be modeled somewhat accurately and with reasonable efficiency by a cyclic NN.
Unless you have religious objections, it's also quite reasonable to call the brain a computer.