1,279 karma · joined August 31, 2013
[ my public key: https://keybase.io/poppingtonic; my proof: https://keybase.io/poppingtonic/sigs/bkWTUUgvF-hPLoKKg5asnSdZul2o9KdCmvSaQNLmm-s ]
Using a REPL-based language like Lisp (which I learned from reading advanced Lisp textbooks) for several years before I worked professionally as a programmer enabled me to dive into complex, underexplored parts of the (Python, C) projects at my first job, which meant I basically owned some very important parts of the stack.
Reading and applying ideas from Unix sysadmin books enabled me to be comfortable jumping around the OS very quickly, giving me a speed advantage even when the computer I used was pretty underpowered, relative to my colleagues, early in my first job.
2. Yes. You can make everything project-specific if you want to. e.g. Image segmentation datasets are just slightly modified Dataset classes.
3. fastai extends PyTorch in a very Pythonic OO sense, so I think the only speed issues could come from that, and maybe maintaining a few extra dicts in memory. If it's about i/o, probably not, if it's about parallelization (for nlp), definitely not. In fact, I can't think of a way in which there's a significant speed penalty.
Edit: also, find datasets online that fit in your interests. There's no better motivation than to solve problems in a domain that you're already familiar with. I grew up on a farm and built a classifier to detect diseases as part of my fast.ai course-work: https://t.me/shambadoctorbot
[1] http://metamodern.com/2009/05/27/how-to-learn-about-everythi...
[2] http://metamodern.com/2009/05/17/how-to-understand-everythin...
arXiv:1707.08475 [stat.ML] (or arXiv:1707.08475v1 [stat.ML] for this version)
The diagram comes from the book "The Act of Creation"[1], where Arthur Koestler discusses the common themes in creative acts, including the idea of juxtaposition.
In research, you start with a baseline level of knowledge and do a random walk until you encounter a (not necessarily) totally orthogonal set of ideas. Once you combine the two, boom! Something new is created. A lovely book, that I'd recommend to anyone.
[0] http://www.vpri.org [1] https://en.wikipedia.org/wiki/The_Act_of_Creation
Edit: I'm referring to the journal, not the author.
If you are a beginning designer, you should realize that no design is sacred. To learn to design, you must disregard reverence for another’s model, and be willing to pull it apart, fold it differently, change it and see the effects of your changes.
Small ideas lead to big ideas; the concepts of design build upon one another.