All this attention (read: likes, shares, and page views) is making me wonder whether it's worthwhile to write an update (or even a second edition). What do you think? What would you like to see changed or added?
837 karma · joined November 12, 2012
All this attention (read: likes, shares, and page views) is making me wonder whether it's worthwhile to write an update (or even a second edition). What do you think? What would you like to see changed or added?
$ curl -s http://datascienceatthecommandline.com | pup '.sect3 > h3 text{}' | head
alias
awk
aws
bash
bc
bigmler
body
cat
cd
chmodDSATCL discusses the ideas behind various cleaning and visualization approaches and several machine algorithms, but only briefly. My personal recommendation would be to first gain some experience with these topics using Python and/or R. If you're afterwards curious to find out how the Unix command line can help to do data science, well, then there's only one book I can think of! ;)
As an independent data science consultant and trainer, I help organizations making sense of their data. Additionally, for one day a week, I'm an assistant professor of data science at Tilburg University. Previously, I was a data scientist at Elsevier in Amsterdam and startups YPlan and Outbrain in New York City. I have an MSc in artificial intelligence from Maastricht University and a PhD in machine learning from Tilburg University. Recently, I wrote a book titled Data Science at the Command Line, which was published by O'Reilly Media. My website (http://jeroenjanssens.com) provides a more detailed overview of my background.
I have experience and affinity with: analyzing data using R and the Python scientific stack; organizing workshops and meetups; writing and presenting for technical audiences; managing data in MySQL, MongoDB, Redis, and AWS S3; collaborating with international teams of engineers and data scientists; programming in Python, JavaScript, and Bash; visualizing data with ggplot, TikZ, and D3; and performing large, distributed experiments.
I'm currently available for three to four days a week. Simply drop me an email at datascience@jeroenjanssens.com and we'll take it from there. Looking forward to it!
[1] https://www.digitalocean.com/community/tutorials/how-to-use-...
$ echo 'header\ne\nd\na\nb\nc\nb' | body sort | body uniq
header
a
b
c
d
eSee this blog post I wrote a while ago for an example: http://jeroenjanssens.com/2013/09/19/seven-command-line-tool...
The Data Science Toolbox also contains Python and the most popular packages for doing data science. Besides that, it also contains R and, again, some great packages.
The main difference, though, is that the DST aims to be a platform where authors and teachers can create custom software and data bundles for their readers and students. (I have been thinking about creating a bundle that would install Anaconda on the DST.)
If you only need to use Python, then Anaconda may very well satisfy your needs. Good luck!
[1] http://jeroenjanssens.com/2013/12/07/lean-mean-data-science-...
The initial reason I created DST was that I'm currently writing a book called Data Science at the Command Line. Installing the command-line tools discussed in this book is unfortunately not straightforward. I wanted to offer potential readers a Vagrant box (with a shell provisioner) that installs these command-line tools. Similar to what Matthew Russell has done for his book Mining the Social Web [1]. This blog post [2] provides some more explanation and compares four different solutions.
The software packages that you mention sure are exciting! If there is an author or teacher that wants to teach these to her readers or students, then we should create a bundle (i.e., Ansible playbook) for them!
[1] https://github.com/ptwobrussell/Mining-the-Social-Web-2nd-Ed... [2] http://jeroenjanssens.com/2013/12/07/lean-mean-data-science-...
I wrote this script a while ago. I just needed to update the request because the API had changed a bit since then. Please note that it depends on the scrape tool in the same repository, which in turn depends on the python packages lxml and cssselect. But once you have that set up, you can explain commands from the shell! :-)
As for the roll call voting data, the dataset has 103 data points, where each data point has 172 features. The outlier probability of a senator depends on the location of its corresponding data point in the 172-dimensional space.