Yes! Right click on the exe file and change the startup options to do a full reboot into DOS. Definitely needed for the games that were hard coded to use the first MB of RAM
Or for any games at all on a low/mid-range machine of the time. The overhead of Win95 crippled almost all DOS games on my machine. They might as well not have bothered with compatibility.