I think walking through walls would be very unlikely.
I spoke with someone who used VR goggles many years ago. The tech demo he was show was simply being in a room with a bottomless pit in the middle. He said even though you knew that in reality there was a carpeted floor, it was impossible virtually impossible to make yourself walk over the pit. You just had way too many mental blocks that stopped you from doing it.
I imagine something similar would happen with a wall. It would feel very eery and uncomfortable to walk through the wall.