Hacker News Reader

Comment by csvan | Hacker News Reader

First TensorFlow, then Baidu's Warp-CTC, and now Microsofts CNTK. It is a very, very exciting time for open source machine learning indeed.

View on HN

Don't forget SystemML[1] and Singa[2], as well as venerable systems like Mahout[3] and SAMOA[4].

[1]: http://systemml.apache.org/

[2]: https://singa.incubator.apache.org/

[3]: http://mahout.apache.org/

[4]: https://samoa.incubator.apache.org/

Also Microsoft's DMTK: http://www.dmtk.io/

Definitely !

I'm looking forward to a review of the major systems available by someone who has a clue (i.e. not me). The investment to learn one of these is great enough that it will be worth some time invested to understand what each can do.

Afaik CTC is just a loss function written for Torch, no? A few hundred lines of code vs. hundreds of thousands loc for TF or CNTK.

I think the guy was going for "big company something something Open Source", and not knowing what they actually were

https://software.intel.com/en-us/blogs/2013/avx-512-instruct...

"...Worry about scaling; worry about vectorization; worry about data locality...." http://www.hpcwire.com/2016/01/21/conversation-james-reinder...

Nvidia Chief Scientist for Deep Learning was poached from Intel https://il.linkedin.com/in/boris-ginsburg-2249545?trk=pub-pb...

http://www.cs.tau.ac.il/~wolf/deeplearningmeeting/speaker.ht...

AVX-512 instructions https://software.intel.com/en-us/blogs/2013/avx-512-instruct...

"...In a very interesting admission, LeCun told The Next Platform ..." http://www.nextplatform.com/2015/08/25/a-glimpse-into-the-fu...

Yann LeCun states on Nov 2015 (29:00 min mark) GPU's short lived in Deep Learning / CNN / NN https://www.youtube.com/watch?v=R7TUU94ir38

https://www.altera.com/en_US/pdfs/literature/solution-sheets...

http://icri-ci.technion.ac.il/events-2/presentation-files-ic...

http://icri-ci.technion.ac.il/files/2015/05/00-Boris-Ginzbur...

Except that it appears to require MKL or ACML...

Sigh...

./configure

Defaulting to --with-buildtype=release

Cannot find a CPU math library.

Please specify --with-acml or --with-mkl with a path.

At least ACML seems to be open source now too.

"ACML End of Life Notice: We have transitioned our math libraries from a proprietary, closed source codebase (ACML) to open source solutions"[1]

[1] http://developer.amd.com/tools-and-sdks/archive/amd-core-mat...

And, if I recall, MKL is included in Microsoft R Open (previously, Revolution R Open). At least, that's what the instructions here[1] lead me to believe.

[1] https://mran.revolutionanalytics.com/documents/rro/installat...

Microsoft employee here. MKL libraries and headers will show up in CNTK soon. We are working with Intel on this.

Thanks for this, I personally have a license for MKL due to a licensed Intel C++ compiler and it really does a good job. I feel that Intel should do more to get MKL out in the open and more in use by the Open Source community. For instance I would love to have access to their FFT code so I could optimize it for my specific use case, but right now things are a black box. Very excited about CNTK btw, releasing a fully cooked multi machine distributed framework is just awesome.

That's good news. The requirement to purchase the Intel C compiler and tools like MKL before programming their processors efficiently is IMO one of the chief reasons why NVIDIA is kicking them to the curb here with 6.6 TFLOP $1,000 consumer GPUs that come with an enormous toolkit of free candy, including a DNN kernel library that plugs into all the important frameworks.

Compare and contrast with ~1 TFLOP ~$7,000 Xeon CPUs.

I have brought this up with multiple Intel engineers and for the most part they nod and agree. Then they tell me that there's no way Intel would ever start doing things like NVIDIA does here. And then I nod and tell them why I continue to bet on NVIDIA for the immediate future, sigh...

There's a joke that says those that hate Windows use Linux, and those that love unix use BSD.

I think this recent open source push by microsoft is depending on the truth of that statement. I think they're working under the assumption that the recent push of developers using Linux has more to do with those developers wanting to use a superior open source environment than preferring Unix/Linux as an operating system.

All of their open source stuff is really easy to use, IFF you're also using all their other open source software and Visual Studio.

If you're the type of developer who is only using Linux because it has the least path of resistance to using open source libraries and software, they're making good progress towards getting you back into a microsoft ecosystem.

If you're the type of developer who likes the free software philosophy, they're not trying to grab you, because they feel that's not a sizable portion of the people using Linux.

I think they're probably right.

I don't like Windows because I find it awkward to use, and the UI changes between major releases seem mostly gratuitous. I don't really hate it on general principles, i.e. because it's not free/open.

Don't forget IBM released SystemML

Reply on news.ycombinator.com