I recall vesa was only used for graphics cards. There was ISA and extended ISA for the rest (like modems and sound cards).
VESA Local Bus supplemented ISA. It did mostly see use as a graphics card expansion slot, but you could get various I/O cards. I saw a couple of boards in my lifetime that had those slots, thankfully didn't need to support them.