There are libraries, like fastutil, that provide collections for primitive types.