I think it's worth also reading http://ospflor63.stanford.edu/upload/An-Introduction-to-Stoc... which is quite informative.