I remember learning something akin to this in social psychology in the context of a single risk-taker fish breaking from the school of fish to explore and take risks which ultimately benefitted the whole group.
I remember learning something akin to this in social psychology in the context of a single risk-taker fish breaking from the school of fish to explore and take risks which ultimately benefitted the whole group.
I didn’t research machine learning, but my friends did, so it could have been an idea I picked up from someone else.
Anyway, I think it’s a valuable framework because we need to make time for exploration—it’s a great way to let go, have fun, and dissolve the fear of failure.
The general idea is that your agent, however it is training, has to balance trying new things to possibly find the global maxima instead of getting hooked on a rewarding local maxima.
https://en.wikipedia.org/wiki/Reinforcement_learning#Explora...
here an n-gram of the first mentions: https://books.google.com/ngrams/graph?content=Exploration-ex...