5,680 karma · joined September 9, 2012
- punishment usually comes too late and also makes the trainee dislike the trainer and so makes future training harder
- rewards should come immediately at success
- since most rewards can't be given immediately, develop a cue (a "clicker" is popular) which you give at the immediate moment that informs them they're about to get the reward. This bridges the time span between act and reward, and the cue itself becomes valuable to the trainee later
- variable rewards often work better
- trainees in a rut can sometimes be jolted out of the rut by giving them an undeserved reward jackpot
- teaching a trainee to not do something is harder but one strategy is to teach them to do it on command. Then simply don't never give them the command. Most behaviors die out once trainned to command except when commanded
- or train them to do something that is incompatible with the undesired behavior
- bizarrely, stopping doing an undesirable task can be reward enough to train them to do the undesirable task. I'm not super clear on how you do this in practice
- giving cues and rewards too late is a common error. It's counterintuitive because you often must interrupt the behavior you are training. Rewarding your dog for sitting will cause the dog to stop sitting, but you must do this. Waiting until the dog stops sitting is too late since then you are rewarding the stopping of sitting, not sitting itself.
- all of this applies to humans (if you don't let them know what you're doing) and also to yourself, supposedly
I'm trying to train my misbehaving cat. We're making some progress but it's not as fast and magical as the book makes it sound (my inexperienced training skills likely contributing).
I'm also learning Mandarin and a lot of what I've learned is through apps like Anki. Feedback is instant. But it doesn't really feel that rewarding to get a card right, so I'm not sure how successful it is in a Skinnerian sense. Teaching machines are here and work but I think they're still suboptimal.
An example is a paper with several mouse experiments. In results it'll often have a single section saying that mice were raised such and such under conditions A or B. They were treated with X or Y and samples were collected after certain times. But was Y treated on A or B mice? From results its clear that X was done on both but no mention for Y. I guess A is more the default and they'd have specified B if that were the case, so probably A.
PMC also makes everything uniformly formatted which is often a benefit, though sometimes equations can be worse.
On the other hand, taking heat into account just makes matters worse in the summer, and I haven't known a gamer who takes half the year off.
https://www.ohchr.org/en/professionalinterest/pages/righttod...
In particular, it's equally valid and frankly nicer to define the unit n-sphere to be volume 1 rather than the unit cube. Do that and we see that this statement is just saying that the n-cube grows in volume to infinity, which makes sense given the fact you point out that it contains points increasingly far from the origin.
I have a hobby of turning surprising facts about the n-sphere into less surprising facts about the n-cube. So far I haven't met one that can't be 'fixed' by this strategy.
But of course they do get misused and there's not much more demoralizing than getting stuck on something 'obvious.'