HNHacker News
TopNewBestAskShowJobs

rvlasveld

102 karma · joined July 12, 2013

submissionscomments
rvlasveld··on Introduction to Support Vector Machines
Thank you for your nice reply; currently I don't have time to look at your suggestions in depth, but I can give a (short) notion of my interpretation of 'change detection' in this context.

I will consider a signal from accelerometers in a smartphone. There are already many algorithms to determine the activity an user is currently performing (such as walking, jogging, biking, sitting, etc). Often these methods take windows of time (1-2 seconds) and compare characteristics with learned models. This way the time series data is clustered/classified into models. An additional result from this is an (implicit) segmentation of the time series arises.

My theory is that when the segmentation of the time series is first performed explicitly, the (bigger) chucks of data can be better characterized. So my goal is to find the change points in the time series; and a change points means that the underlying process (being the user carrying the phone) has changed (e.g. from walking to running).

I want to detect the change point using novelty-detection techniques; so roughly speaking: when a certain number of data points are considered "new"/"outlier", I assume there is a change in the signal and report that moment of time. Then the model adapts to the new distribution of data and watches again for a change point.

rvlasveld··on Introduction to Support Vector Machines
The minimization function is indeed "as a fact"; in the sense that it is (somewhat) the formulation of Cortes and Vapnik (http://link.springer.com/article/10.1007%2FBF00994018), which is the main formulation for Support Vector Machines.

The value of 'b' is minimized and the value if found in the first constraint. The value "b\||w||" determines the offset of the hyperplane to the origin and 'w' is the normal vector of that plane.

rvlasveld··on Introduction to Support Vector Machines
Nice to hear you enjoyed it. SVMs are indeed quite familiar in the machine learning community. But I think (and hope :)) that more introductory material will help others. And the examples on one-class classification is not that exhaustive. I hope to be able to write a follow-up on novelty detection in time series; that is the main subject of my master thesis.