Yes, USB support was only available in OEM versions of Windows 95 -- starting with OEM Release 2.1 (http://support.microsoft.com/kb/253756).

Windows 98 was the first with native USB support.