Where does the performance difference come from? And in what kind of processor & gpu? I didn't even know llama.cpp had a 32 bit option. For now I'm pretty suspicious it's a fair comparison.
Jlama uses the vector api in java20 but also better thread scheduling with work stealing and zero allocation.