No. That is not crazy. I work for a company that has several (50% or so) remote workers - we are a tech company.
I suggest looking for a new job. Companies that do not already have a remote working policy are not going to be a conducive environment for you to start your remote career at (if you are even able to convince them).
If you're interested in startups I suggest angel.co. For other opportunities you should checkout weworkremotely.com and authenticjobs.com. Other than that a quick google search for "companies that allow remote work" should suffice.