HNHacker News
TopNewBestAskShowJobs

cabinpark

170 karma · joined February 3, 2014

submissionscomments
cabinpark··on Data Scientist Interviews
That doesn't answer the question.

When I hear the term data scientist, I assume that the person has extensive training and background in statistics and mathematical modeling. I work with large data sets all the time as a scientist and can run all the standard statistical tests but I would hardly consider myself a data scientist.

cabinpark··on Colleges Want Students with Character, But Can’t Measure It
While I can understand that for basic stuff, there is no way I would ever attend an online course on some advanced undergraduate topics in physics or mathematics online.

There is a benefit of being in a classroom environment when learning an advanced subject. You have a direct connection to the professor and other students, which is essential for advanced material. Plus you can easily go and talk to them afterwards for more details. I learnt a lot by going to professors office hours which doesn't work online.

Also, what about labs? Every science program I am aware of has a laboratory component. That cannot be done at home. Plus good luck trying to get universities to agree on what labs to do. Each university has different types of researchers who focus on certain areas, which is reflected in the labs selected. My former university, for example, had no particle physics people so any lab related to particle physics would be misplaced. Instead they had a lot of quantum people so the labs were more geared towards that. I know of another university that had a lot of particle physics people and their labs reflected this.

Another thought is research. How would undergraduates get exposed to research in your system?

Thinking about it more, having TA'd first year calculus, you need to be able to interact in real time with students. I think online resources are great and I recommended them to my students, but they cannot replace face to face interaction. This is something online technologies cannot replicate, so I say it is a bad idea to even do it for basic things like calculus, which is very fundamental to the sciences.

Personally, I think it is a noble goal, but unlikely. Instead, I think the universities should integrate online stuff in addition to in classroom lectures.

EDIT: I forgot to mention the university environment. Being surrounded by my peers in the same field really helped. I learnt a lot just by hanging around the various clubs. That absolutely cannot be replicated online.

cabinpark··on Math topics useful for computer science/programming
Linear algebra is insanely important. I would consider the most important area of numerical mathematics to know. Any sort of mathematical modeling you do is going to involve linear algebra at some point.

I have argued that almost all numerical mathematics, in some form, can be modeled as a linear algebra problem. Google's original page rank algorithm is linear algebra. Remember that Netflix challenge? All linear algebra. Optimisation? Linear algebra. Want to do any engineering of a system? Behind the scenes it is all linear algebra as every single numerical technique for solving PDEs, that I am aware of, can be thought of in a linear algebra sense. Fluid modeling is all linear algebra. A lot of the machine learning I've seen is just linear algebra. I would also that almost every simulation running on the world's supercomputers involves linear algebra.

Do you absolutely need linear algebra to do this things? No. Just like I don't need to understand how my car works to drive it. But having an understanding how these systems operate can really help you use them in a more logical way.

cabinpark··on Tptacek's Review of "Practical Cryptography With Go"
And yet in every scientific paper I have read they still spell out the abbreviations the first time. And these are written by experts in the field. Why? Because it removes ambiguity and makes it completely clear what you are talking about. What if in 20-30 years the acronyms change or fall out of favour? It happens all the time.
cabinpark··on Heartbleed and the misconceptions about Open Source
I've always interpreted Linus's law in the following way: given a bug, there will exist someone to whom the bug is obvious and will immediately spot it. However the law doesn't state how many people you would need to check, it might be 2 or it might be 100,000 required.
cabinpark··on Python 3.5 to Ship with Matrix Multiplication Operator
I would argue that almost every single linear algebra routine can be interpreted in some form as a matrix-matrix or matrix-vector multiplication. Considering that matrix-matrix and matrix-vector are fundamental numerical operations (they are part of BLAS which are the basic API functions called by every single linear algebra routine I know of) having a concise notation is key.

And since formulas can get complicated quickly, having a closer 1-1 correspondence with the mathematics is critical for understanding the meaning of the code. The PEP contains a nice example from statistics. And trust me, when you are writing numerical code, being able to read the mathematical formula clearly is essential, especially when you have a lot of formulas and need to figure out why your code is giving you numerical non-sense.

cabinpark··on Mathematicians are chronically lost and confused
So? Why does it have to be computer parseable and checkable? I've never heard anyone complain about that before.

As for your other comment, DerpDerpDerp provides a good answer.

cabinpark··on Mathematicians are chronically lost and confused
> Often I find I spend days or weeks deciphering mathematics in compsci papers only to find the underlying concept is intuitive and plain, but you're forced to learn it bottom up, constructing the authors original genius from the cryptic scrawlings they left in their paper... and you realise a couple of block diagrams and a few short paragraphs could have made the process a lot less frustrating.

You have the benefit of hindsight. Everything is obvious in hindsight. All the research I've done is obvious and straight forward, if only I had known what I know now and would be able to draw a few simple diagrams.

That is, until you realise it's not. In those days and weeks spent deciphering mathematics you are actually learning a lot. I cannot count how many times I've been reading mathematics and struggled for weeks on a concept. Then one day it clicks and it all makes sense. Then I re-read the description again and the answer is clear as day. The answer was always there, I just hadn't learnt enough to appreciate it.

>So many ideas seem closed to mortals because of the nature of mathematics.

I disagree with this statement 100%. No ideas are closed because of mathematics. The ideas are only closed if you are not willing to put in the time.

cabinpark··on Mathematicians are chronically lost and confused
> I think if the purpose is merely to transmit proofs and axioms unambiguously, I think we can have a language that performs just that and nothing else

We do. It's called mathematical notation.

cabinpark··on Algebraic and calculus concepts may be better way to introduce children to math
A big secret in mathematics is that many ideas in mathematics are rather simple and straight forward.

Formulating and proving these ideas in a rigorous and logical manner, however, is the difficult part.

cabinpark··on Getting a PhD in Norway is nearly free--even if you're not a citizen
Wow that's the worst. I would NEVER pay for a PhD out of my own pocket. I mean, yes the PhD isn't "free" in the sense of I don't pay tuition. I do but it's included in my funding.

I asked a former university staffer about it once and they told me the money doesn't exist. The university "charges" me x dollars per term, but in my funding there is conveniently an extra x dollars per term in addition to my y salary from the university. So I then tell the university in my funding forms that they owe me x+y dollars and they are like "oh, well we have to deduct x dollars for your tuition". So the net effect is the money doesn't actually exist.

What subjects were these PhDs in by the way?

cabinpark··on Getting a PhD in Norway is nearly free--even if you're not a citizen
I have never heard of a PhD student who isn't getting paid to do research. Even at the Master's level, most students were getting paid, with the exception of the coursework people. Are there people who are actually paying for their PhDs? If so that is definitely not the norm.
cabinpark··on Why is printing “B” dramatically slower than printing “#”?
Never assume something is common knowledge! I've seen many links to mathematics things here on HN that I would consider "common knowledge" yet many people were unaware of them.
cabinpark··on Julia, the One Programming Language to Rule Them All
Haha, completely true. Still it's not as explicit as it could be. Am I being nitpicky? Sure, but the word "graphical" only appears in the context of the IJulia notebook. Again if you want to really sell this to scientist, really explain the graphical stuff since plotting is an essential part of doing computational mathematics.

It is interesting your example about Matlab. Did you design it with vectorisation in mind? Not to dismiss your coding skills, but I've seen a lot of poorly-designed Matlab code that just doesn't exploit the Matlab language. The office mate I mentioned above was one of them. I took a look at his code once and vectorised it and something that was taking 10 minutes took 30 seconds.

I am definitely going to use it on future projects. Since right now I'm finishing up stuff it wouldn't make sense to re-write all my Matlab processing routines into Julia. I think a good specifically designed open-source version of Matlab is needed. Yes I know about Octave but I've never seen anyone really use Octave since it never seems to work for more complicated things.

cabinpark··on Julia, the One Programming Language to Rule Them All
I'll admit that is an interesting feature honestly the first thing on the list? It's certainly a cool and interesting idea, but I'll admit it's not a super important feature in my view. Thinking back on all the research I've done I can't think of a single time where I would need such a feature. I never use any data strucures beyond matrices, which Matlab handles by default. Since 1x1 matrices are just numbers, every function that works for matrices, works for single numbers.

I do use Python, but it came into it late on my project. Future projects will definitely use Python since it's good enough for data processing stuff. Hard core numerics will still be done in Fortran/C.

I definitely do see Julia being the better version of Matlab but it certainly has a ways to go.

cabinpark··on Julia, the One Programming Language to Rule Them All
I keep seeing Julia promoted as the grand new language but honestly, I am incredibly sceptical. Working in the scientific programming community, I am keenly aware at how slow things move. In only the last few years have I seen a push towards even using Python as a viable scientific tool. The problem is that science moves slow and, for the most part, scientists aren't interested in the programming aspect too much, but getting the results. They have one system that works and they stick with it.

One problem, that I don't see mentioned, is that verification of correctness. There is a reason people use decades old packages and code: they know that the tool is reliable and correct. My supervisor's code is based off his supervisor's code, which has been around since the 80s. At least 50+ papers have been published based off this specific code so we know that it is correct. The amount of time it would take to re-write and test the code written in a new language would be a very large times-sync that no one wants to do because they could spend that time doing research. I think this is part of the reason why things change slowly in the scientific computing community as whole. There have been tens of thousands of papers published that use Fortran/C/C++/Matlab and this new kid Julia comes along and how many scientific papers have been published using Julia code? I would imagine barely even a fraction. To scientists, this is reason to be sceptical. I'm not saying I agree with this but it is how scientific computing does think.

Also, on a personal note, the marketing needs to change. Since of the creators is reading this, if you want get the scientists, drop the grandiose claims of "one language to rule them all", although that's probably not your fault. To me, I immediately smell bullshit a mile away when I hear that. Too many times in the history of scientific programming languages have people made similar types of claims only to see it crash and burn. This is why many the older folks won't bother.

Reading Julia's homepage, I would be unconvinced about why I should choose Julia over Matlab. Heck, why not use Python? Python is open source and has been around a lot longer and people have certainly of that.

Also your speed tests, well fix them. For example Matlab vs Julia. Calculating the Fibonacci numbers? Honestly who cares. Plus why are you even computing them recursively, that's a silly way to do it. I understand it demonstrates recursion, but it's a pretty useless thing in my opinion. I only ever see the Fibonacci numbers come up in programming contest problems. I can honestly say I've never seen them used in real applications that scientists do. And if they were you would never implement them this way. Also the implementation of quicksort, why did you write your own? Use the built-in one for a more fair comparison. No one writes their own sorting algorithm but uses the built-in languages ones. Do that here. It is disingenuous to Matlab to not use the built-in functions.

The real tests that I would care about would be the random matrix multiplication. That's something that is way more common than calculating Fibonacci numbers. And here Julia is a little faster than Matlab but not too much. I'd be sceptical of why I should switch. Similarly a single number tells me nothing. Just because it says Julia is faster, well that's one test. How well does Julia scale? Is it true that Julia is faster than Matlab for multiplying NxN random matrices? How well does this scale? A single test tells me nothing. I'm obviously bias towards matrix tests since my research used a lot of matrix operations, but if you read papers about various codes they almost always include scale tests. This is what my colleagues would care about more than anything since they have massive datasets so scalability is critical. Remember you are trying to sell this to scientists who are, obviously, scientists, so having good quality data to show them is critical. I discussed Julia with my colleagues and this was one of the things we immediately mentioned. The tests shown didn't convince us at all that it was even worth considering.

Plus, I'll be honest, I feel the homepage is marketed more towards computer scientists than numerical scientists. The first feature is "Multiple dispatch: providing ability to define function behavior across many combinations of argument types". The hell is that? Why do I care? Remember who your audience is! To give you an example, I will tell you about my office mate. He is a PhD student working on turbulence and uses Matlab for all his data processing afterwards. His code comes from simulations written in Fortran that run on the local supercomputing cluster. They are stored in the NetCDF format. After the simulations are done, he opens up Matlab, reads in the NetCDF file and runs a bunch of data-processing functions to compute various quantities from the raw data. He then plots these things. On the Julia homepage I don't even know if Julia can even do graphics. Can it? If it can, the homepage doesn't mention any plotting libraries. So, I repeat, what exactly does multiple dispatch mean and why is it so important? If you want him to be using Julia, then you need to explain to him why he should be using it over Matlab. Look at the numpy homepage. It is short and to the point. Plus it has a nice link to "NumPy for Matlab users" which is something I would want to know immediately. Julia, as far as I can tell, you have to go to docs, Julia manual, Noteworthy differences from other languages (which is at the bottom of the screen!!).

I could probably come up with more criticisms and suggestions but I don't want to write a book. I should say, I completely and fully support what Julia is trying to achieve. I find that Python is just too awkward to be a good Matlab replacement. To me, Python is a very general tool that also has the ability to do similar things to Matlab. However since Matlab is designed to do numerical computing, and Python isn't, I find Python to be awkward for some things. But, at least it can run on the computing clusters. Matlab is stupid with licensing and trying to get it to run on the supercomputing clusters is near impossible. Definitely in the future I am going to try Julia as a data-processing step since it is free and open-source and not subject to any of that licensing crap. Plus the parallel aspect interests me although I have no idea how good it is since I don't see any graphs showing what sorts of advantages I might get. Plus the documentation page is rather dense text-wise and not that appealing to read right now.

But, I think the tl;dr is that remember who you are marketing to. Remember that scientific computing moves slow. I know colleagues who have just discovered version control and think it's amazing.

← PreviousPage 3 of 3