HNHacker News
TopNewBestAskShowJobs

georgismilyanov

3 karma · joined October 11, 2013

submissionscomments
georgismilyanov··on (Big?) Data Question: Searching in a large dataset
No. That's the point. It is a simulation of a complex system. The interactions between the mice are everything.
georgismilyanov··on (Big?) Data Question: Searching in a large dataset
It is not simultaneous. I use the Gillespie technique for stochastic simulation. I select a mouse at random to change boxes, depending on its transition rate compared to the transition rate of the system as a whole.
georgismilyanov··on (Big?) Data Question: Searching in a large dataset
Exactly.

There are four types of meeting: mouse 1 entered -> mouse 2 entered -> mouse 2 left -> mouse 1 left; mouse 1 entered -> mouse 2 entered -> mouse 1 left -> mouse 2 left; mouse 2 entered -> mouse 1 entered -> mouse 1 left -> mouse 2 left; mouse 2 entered -> mouse 1 entered -> mouse 2 left -> mouse 1 left.

Then the meeting record contains the times the two were together and the duration of this.

The dumb approach is very slow. Would it be a good idea to read all stay results in Scala (or whatever) and try to do the searching in memory, completely eliminating th db? But then the comparisons would be more expensive...

georgismilyanov··on (Big?) Data Question: Searching in a large dataset
Thank you! But I am thinking, could I be able to obtain easily the duration of each meeting using this setup? This is what I would ultimately need (to construct the empirical cdf, social network, etc.)
georgismilyanov··on Lisp Web Tales
i would be curious to learn more about you, Pavel. what do you study? are you from Bulgaria?