That is about as uneducated a take as one could possibly have.
Keep in mind "isekai" as a genre also exists in western entertainment; A Connecticut Yankee in King Arthur's Court and The Chronicles of Narnia are some prominent and famous examples. Are those specifically for shut-ins and nerds too?