Hacker News Reader

jeroenjanssenson Python Polars Cheatsheet (based on our O'Reilly book)

Yes, opensource.posit.co is entirely open source :)

https://github.com/posit-dev/open-source-website/blob/main/c...

jeroenjanssenson Python Polars Cheatsheet (based on our O'Reilly book)

We spent the last few weeks compressing our book, Python Polars: The Definitive Guide (nearly 500 pages), down to a two-page cheatsheet. It's a highly lossy compression, but hopefully a useful one! Besides the PDF, there's also an accessible HTML version.

We're curious to hear what you think. Let us know if we missed any of your favorite Polars operations, or if you have any feedback on how we organized it.

jeroenjanssenson Plotnine

While it’s generally considered to be bad practice to import everything into the global namespace, I think it’s fine to do this in an ad-hoc environment such as a notebook as it makes using the many functions plotnine provides more convenient. An additional advantage is that the resulting code more closely resembles the original ggplot2 code. Alternatively, it’s quite common to `import plotnine as p9` and prefix every function with `p9`.

Disclaimer: I made the plotnine homepage and cheatsheet.

jeroenjanssenson Ask HN: Best way to learn robotics with a 10 year old?

You can probably get these sets second hand. I just revived a bricked one (hah!) myself. Had to use the Lego software to update the firmware for that, which only runs on Windows 7, 8, and 10.

I just got NXT-Python [1] working on macOS via a USB cable. No luck pairing the brick to my MacBook via Bluetooth yet. Nevertheless, I can't wait to get building robots with my kids!

[1] https://ni.srht.site/nxt-python/latest/handbook/overview.htm...

jeroenjanssenson ht: Headless Terminal

I've created tmuxr, an R package to manage tmux [0].

[0] https://github.com/jeroenjanssens/tmuxr

jeroenjanssenson Data Science at the Command Line, 2nd Edition (2021)

Author here.

Worth pointing out that the discussion from Sept 19 2013 is actually about a blog post, which predates the book. It's because of the amount of feedback it got on HN that I wondered whether this topic could be turned into a book.

Coincidentally, tomorrow I'll be speaking at the New York Open Statistical Programming Meetup [0]. About 11 years ago, I spoke there for the first time. That talk is the reason the aforementioned blog post (and by extension the book) exists.

In short, I owe a lot to that meetup and the HN community. Thanks!

[0] https://nyhackr.org/

jeroenjanssenson Python Chart Examples

I also thought it was made with TikZ (which is a compliment). I used TikZ for my thesis: https://jeroenjanssens.com/phd/ and same thing here, the code is a mess.

jeroenjanssenson Polars

Luckily our book will also be available in hard copy so you can digest all that hard-won knowledge in an offline manner :)

jeroenjanssenson Polars

Ritchie Vink (the creator of Polars) deliberately decided not to write a book so that he (and his team) can focus full time on Polars itself.

Thijs Nieuwdorp and I are currently working on the O'Reilly book "Python Polars: The Definitive Guide" [1]. It'll be a while before it gets released, but the Early Release version on the O'Reilly platform gets updated regularly. We also post draft chapters on the Polars Discord server [2].

The Discord server is also a great place to ask questions and interact with the Polars team.

[1] More information about the book: https://jeroenjanssens.com/pp/

[2] Polars Discord server: https://discord.gg/fngBqDry

jeroenjanssenson Polars: Company Formation Announcement

Thanks! Our goal is to have it published in Q3 2024.

jeroenjanssenson Polars: Company Formation Announcement

This is great news. Makes me proud to be a co-author of the forthcoming Polars book [0]. Congrats to Ritchie, Chiel, and the rest of the team!

[0]: https://jeroenjanssens.com/pp

jeroenjanssenson The Linux Command Line

Related: Data Science at the Command Line

https://datascienceatthecommandline.com/

Disclaimer: I wrote it. Plugging it here because (a) it's related, (b) it's free to read online, and (c) would not have existed without HN.

jeroenjanssenson Bash one-liner to produce a list of HEX color codes that read like English words

My book Data Science at the Command Line has a chapter about this that scratches the surface and lists some resources in case you want to dive deeper [1]. I can also recommend checking out packages such as Rich [2] and Click [3], if only to get an idea of the possibilities when it comes to creating command-line tools with Python.

[1] https://datascienceatthecommandline.com/2e/chapter-4-creatin...

[2] https://github.com/Textualize/rich

[3] https://click.palletsprojects.com/en/8.1.x/

jeroenjanssenson Modernizing AWK, a 45-year old language, by adding CSV support

I often use csvquote [1] whenever I need to process CSV with a command-line tool that doesn't support it. For example:

    csvquote test.csv | awk '{print $1, $2}' | csvquote -u

[1] https://github.com/dbro/csvquote

jeroenjanssenson Pryrite: Interactively execute shell code blocks in a Markdown file

Yup :) https://datascienceworkshops.com/blog/ibash-notebook/

jeroenjanssenson IPython 8.0

I have written a bit about combining Jupyter console with the command line [0]. Not exactly the workflow you describe, but perhaps still useful.

[0] https://datascienceatthecommandline.com/2e/chapter-10-polygl...

jeroenjanssenson 2nd Edition of Data Science at the Command Line Released (Free)

Author here.

Without HN this book probably wouldn't have existed. In 2013 I wrote a blog post that received quite the attention here [0]. Because of that I got the idea to expand it into a book and it allowed me to convince O'Reilly to be the publisher. Also, many of the tools I cover in the book I first found out about here. So, thank you HN!

[0] https://news.ycombinator.com/item?id=6412190

jeroenjanssenson Ask HN: What are some great engineering blogs?

* [Adam Johnson](https://adamj.eu/tech/) - Ansible, AWS, Django, and Python.

* [Julia Evans](https://jvns.ca/) - Linux, Rust, Debugging, Comics, HTTP.

jeroenjanssenson Building Rich Terminal Dashboards

Why does this website write "Un*x" as if it's some kind of swear word?

jeroenjanssenson Show HN: Igel – A CLI tool to run machine learning without writing code

Reminds me of SKLL: https://github.com/EducationalTestingService/skll

jeroenjanssenson Tmux for Mere Mortals

A great feature of tmux is that every action can be automated from the command line using commands such as split-window, resize-pane, and select-layout. With the send-keys and capture-pane commands you can even automate interacting with any process running inside tmux. The man page provides a good overview of these commands. There also exists a wrapper for Python [0] and I'm currently working on one for R [1].

[0] https://github.com/tmux-python/libtmux/

[1] https://github.com/datascienceworkshops/tmuxr

jeroenjanssenson Do we need to worry about artificial stupidity?

I recommend this related talk by Vincent Warmerdam: "How to Constrain Artificial Stupidity" at PyData London 2019: https://www.youtube.com/watch?v=Z8MEFI7ZJlA

jeroenjanssenson Using AWK and R to parse 25TB

Although the docker image is based on Alpine Linux, examining the corresponding Dockerfile [1] may provide some guidance on how to install the tools and their requirements on Ubuntu. Let me know if you have any questions. Always happy to help.

[1] https://github.com/datascienceworkshops/dockerfiles/blob/mas...

jeroenjanssenson Show HN: An old terminal HTML template

And vim keybindings please :)

jeroenjanssenson How It Feels to Learn Data Science in 2019

Absolutely definitely learn Linux!!1

jeroenjanssenson Faster and simpler with the command line: deep-comparing JSON files with jq

Chapter 5 of Data Science at the Command Line (O'Reilly, 2014) mentions `jq` briefly: https://www.datascienceatthecommandline.com/chapter-5-scrubb...

jeroenjanssenson Outlier Detection Techniques (2010) [pdf]

I spent some time thinking about this. See https://github.com/jeroenjanssens/phd-thesis

jeroenjanssenson Ask HN: Who is hiring? (July 2018)

We help teams upgrade their data science skills through hands-on workshops, tailor-made hackathons, in-company coaching, and remote support in subjects such as data visualization, machine learning, data engineering, and programming in R and Python.

We're looking for experienced and engaging instructors to develop, organize, and deliver in-company training next to their full-time job. We're based in the Netherlands, but we operate globally.

If you have expertise in one or more of the following tools and technologies, and you're passionate about passing on your knowledge to others, consider dropping me a line:

    * Python, Jupyter Notebook, and the PyData stack
    * R and the Tidyverse
    * Machine Learning
    * SQL and RDBMS
    * Git, GitHub
    * NoSQL databases such as Mongo, Cassandra, Elastic

Jeroen - Founder & CEO

jeroen /at/ datascienceworkshops.com

jeroenjanssenson Ask HN: What are your favorite terminal programs?

mdp - A command-line based markdown presentation tool - https://github.com/visit1985/mdp

jeroenjanssenson Data Science at the Command Line

http://jeroenjanssens.com/2015/02/19/ibash-notebook.html