processingjs.org hasn't been updated in years, and the java-to-javascript interpreter is full of quirks.
With p5 you can get as close to the metal as you can in JS (for example, it has a WebGL based renderer if you want, and you can use typed arrays for your data). So it's a lot better.
Regarding OF: yes, for computationally intense stuff it's a lot faster, a native OpenGL application written in C++ should be faster than using JS in the browser.
However, it's also a lot more painful to develop in IMO. I tend to work out my sketches in p5js these days, then when I need performance port it over to OF. Given that most of the time the performance bottleneck is either "how many particles" or "how high-res is the input video", testing in p5 is a simple matter of scaling down.