HNHacker News
TopNewBestAskShowJobs

Equiet

271 karma · joined January 7, 2013

submissionscomments
Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
We are using the same kernels as Jupyter, so features like debugging work out of the box. However, we don't have an interface for visual debugging yet.
Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Quick summary: - real time collaboration - integrations (databases, S3 buckets, environment variables) - persistent (and much much faster) filesystem - hardware doesn't shut off - many more features like variable explorer or automatic visualizations - much nicer interface so you can share with non-technical people - paid plan so you can build your data science team around it - no GPU/TPU machines yet, but that's coming
Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Re Dockerfiles: Right now, we need to rebuild your docker images from time to time (e.g. when we make some changes to the kernel). That means that if you create a docker image with `RUN pip install numpy` and we need to rebuild it in a year, you might get a different version which might break things. The correct solution here is to encourage users to always use `RUN pip install numpy==1.19.3`. We already do this in Python cells (when you run `!pip install numpy` we query PyPI and suggest the last version to you), but we haven't added it to Dockerfiles yet. So to set the expectations we have this notice in the docs.

Regarding other issues: We currently record every execution in project history. That means even if you run cells out of order, you can still get a list of commands that shows how you got to the current state.

The next step for us is to start subtly notifying users when they are doing something that could be an issue later down the road (for example executing cells out of order). We already built this, but decided not to ship it yet because it needed more love. The second thing we are working on is interactive/reacting execution. This is very very very cool and brings the experience from the notebook to the next level (at least for me), but needs much more testing.

Reproducibility vs flexibility (in the sense of letting the user do whatever they want if they know what they're doing) is a difficult problem. In the end, it's going to be a combination of friendly nudges and much better experience if users are following the "reproducible" path. However, we never want to limit users in what they are able to do.

I spent a lot of time thinking about this and would be happy to chat about what you're thinking. Feel free to email me at jakub@deepnote.com.

Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
We're building a pretty hard product. We had a nice working demo a year ago, but there's a lot of work to make a platform like this stable. Real-time collaboration is pretty difficult by itself (especially when you're not syncing just text), but we also had to build a computing platform where users can run arbitrary code. That opens us up to everything from a large attack surface to a huge number of quite inventive crypto miners. So we kept building in a private beta until we were confident enough to launch publicly.

Interestingly, ever since we started almost 2 years ago we've been pretty laser focused and there were minimal changes to the vision overall. But we also knew what we were going into and that it'd take time.

Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Thank you! Actually I'm working on that right now.
Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Well, we are not a Jupyter hosting service. There's definitely a lot of work being put into embedding Jupyter into data science platforms (mostly putting Jupyter into an iframe). But at the end of the day, there are limitations to this approach so some things won't work that well.
Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Ship early, ship often. GPUs are coming.
Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Thanks! The difference between Deepnote and MyBinder is that we keep the pool of Docker images as small as possible. That means they are always in cache. You can still write your own Dockerfile, but they are layered on our base image. MyBinder has a lot of work that needs to be done (pulling the image, sometimes building it, etc) which we thankfully mostly avoided.

Regarding the lock-in, it's in our best interest to remain fully compatible. So yes, there'll always be a way how to export your project and run it in plain Jupyter. The hope is the more advanced features (comments, output visualizations, different cell types) will appear in Jupyter over time as well, but it's also up to Jupyter whether they want those features.

Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Thanks! Honest answer: it was faster to implement. Regular sign up via email should be coming soon.
Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Agreed. The way how I see it, it's not a core competency of a notebook though (it's important to keep the medium itself versatile enough), but of an extension. As you mentioned, there are some startups working exactly on this (thus very likely a much better job than a notebook), so it's probably a problem of a missing link (like a nice API for UI extension).

Speaking on behalf of Deepnote, there's no such an API yet, but it's something that I'd definitely like to see and build.

Equiet··on Launch HN: Deepnote (YC S19) – A better data science notebook
Thanks, fixing
Equiet··on Teaching our five year old to code by cheating
I'd try to frame it in a different way. I think the best way how to get someone excited about programming is to show them how to solve a problem they care about.

Kids like to play games, so creating their own game is a problem they will likely care about. If they spent past 10 hours trying to advance to the next level, then showing them how to hack their way to the next level is probably going to get them excited. If they are stuck in a system where everyone's focus is on their grades, showing them how to hack that system will likely get them excited. Even if it involves doing some math.

Equiet··on Show HN: Starboard – Fully in-browser literate notebooks like Jupyter Notebook
Great work!

I'm the founder of Deepnote (https://deepnote.com/). We're working on a data science notebook (primarily focused on Python), happy to share what we've learned. I couldn't find any contact info on the website, feel free to message me at jakub@deepnote.com.

Equiet··on An exploratory statistical analysis of the 2014 World Cup Final
No good reason, it's a bug, thanks for reporting.

Deepnote is a data science notebook and we are capturing the up/down key events in the main app so that you can move inside the cells and also between the cells. This article is using the same codebase but in read-only mode. I forgot to disable it in this mode.

Equiet··on An exploratory statistical analysis of the 2014 World Cup Final
Of course, thanks for the suggestions.

1. I agree, but there is a reason for this. We'll soon be adding the ability to run/modify feature even without the need to sign up so the whole thing will go away.

2. Thanks! We are experimenting with this (the default scheme is different, but we had a lot of people requesting dark mode so trying out different things for the published articles.)

Equiet··on An exploratory statistical analysis of the 2014 World Cup Final
Nice catch, will fix.
Equiet··on An exploratory statistical analysis of the 2014 World Cup Final
Hi, the author of Deepnote here, this is cool!
Equiet··on Ask HN: Who is hiring? (October 2019)
Deepnote | Prague, Czechia | Full Time | https://www.deepnote.com/

Deepnote is a better data science notebook. We work with JavaScript/TypeScript/React/Docker/Kubernetes/Jupyter to build infrastructure for running heavy machine learning workloads and to give everyone access to state-of-the-art data science tooling.

We are looking for experienced developers excited about contributing to open source software and helping researchers, developers and data scientists solve hard problems:

    * Full Stack Engineer (TypeScript, Python, React) | Prague
    * Infrastructure Engineer / DevOps (TypeScript, Kubernetes, AWS, GCP) | Prague
    * Front End Developer (TypeScript, React) | Prague
    * Growth Manager (developer relations, community management, marketing) | Prague
Email us at work@deepnote.com.
Equiet··on Ask HN: Who is hiring? (September 2019)
Deepnote | Prague, Czechia | Full Time | https://www.deepnote.com/

Deepnote is a better data science notebook. We work with JavaScript/TypeScript/React/Docker/Kubernetes/Jupyter to build infrastructure for running heavy machine learning workloads and to give everyone access to state-of-the-art data science tooling.

We are looking for experienced developers excited about contributing to open source software and helping researchers, developers and data scientists solve hard problems:

    * Full Stack Engineer (TypeScript, Python, React) | Prague
    * Infrastructure Engineer / DevOps (TypeScript, Kubernetes, AWS, GCP) | Prague
    * Front End Developer (TypeScript, React) | Prague
    * Growth Manager (developer relations, community management, marketing) | Prague
Email us at work@deepnote.com.
Equiet··on Deepnote – Jupyter Alternative for Teams
JupyterHub is a decent option, but it's still missing a lot of the features you need to really be a productive data scientist, such as IDE support (code intelligence, command palette) or data science related features (reproducibility, versioning or scheduling). It's also up to you to install it and maintain it — something you don't want to spend time on or you might not know how to do (not many data scientist are experts on managing infrastructure and keeping it secure).
Equiet··on Deepnote – Jupyter Alternative for Teams
Google Colab is great for one-off experiments, but it's not something you can rely on for production workloads. You don't have any guarantees your machine will run for some time (it usually shuts down after 15 minutes), it's very difficult to import your existing code and version it properly.
Equiet··on Ask HN: How to performance test React webapps for rendering speed regressions?
Looking for the same. Ideally something that integrates well with Storybook or Testcafe.
Equiet··on Ask HN: Who is hiring? (November 2018)
Deepnote | Machine Learning Engineer, Full Stack Developer | San Francisco, Prague or REMOTE | Full Time or INTERN | https://www.deepnote.org/

Deepnote is a collaboration platform for data scientists. We work with Jupyter/Python/JavaScript/Docker/Kubernetes to build infrastructure for running heavy machine learning workloads and to give everyone access to state-of-the-art data science tools.

We are looking for experienced developers (and interns!) excited about contributing to open source software and helping researchers, developers and data scientists solve hard problems.

Here’s a list of a few more open positions: * Machine Learning Engineering Intern (Python) | San Francisco, Prague or remote * Full Stack Developer (JavaScript, Python) | San Francisco or Prague * Infrastructure Engineer (Python, Kubernetes) | San Francisco or Prague * Growth Marketer (developer relations, community management, marketing) | San Francisco, Prague or remote

Apply at work@deepnote.org.

Equiet··on Ask HN: Who is hiring? (August 2018)
Deepnote | Machine Learning Engineering Intern, Back End Engineer | San Francisco or REMOTE | Full Time or INTERN | https://www.deepnote.org/

Deepnote is a collaboration platform for data scientists. We work with Jupyter/Python/JavaScript/Docker/Kubernetes to build infrastructure for running heavy machine learning workloads and to give everyone access to state-of-the-art data science tooling.

We are looking for experienced developers (and interns!) excited about contributing to open source software and helping researchers, developers and data scientists solve hard problems.

Here are all currently open positions:

    * Machine Learning Engineering Intern (Python) | San Francisco or remote
    * Full Stack Developer (JavaScript, Python) | San Francisco
    * Back End Engineer (Python, Kubernetes) | San Francisco or remote
    * Infrastructure Engineer (Python, Kubernetes) | San Francisco or remote
    * Product Designer (interested in machine learning and data science) | San Francisco
    * Growth Marketer (developer relations, community management, marketing) | San Francisco or remote
Apply at work@deepnote.org
Equiet··on Ask HN: Who is hiring? (July 2018)
Deepnote | Machine Learning Engineer, Full Stack Developer | San Francisco or REMOTE | Full Time or INTERN | https://www.deepnote.org/

Deepnote is a collaboration platform for data scientists. We work with Jupyter/Python/JavaScript/Docker/Kubernetes to build infrastructure for running heavy machine learning workloads and to give everyone access to a state-of-the-art data science tooling.

We are looking for experienced developers (and interns!) excited about contributing to open source software and helping researchers, developers and data scientists solve hard problems.

Here’s a list of a few more open positions:

    * Machine Learning Engineering Intern (Python) | San Francisco or remote
    * Full Stack Developer (JavaScript, Python) | San Francisco
    * Infrastructure Engineer (Python, Kubernetes) | San Francisco
    * Product Designer (interested in machine learning and data science) | San Francisco
    * Growth Marketer (developer relations, community management, marketing) | San Francisco or remote
Apply at work@deepnote.org
Equiet··on Show HN: Wallmine – Google Finance portfolio alternative
Love the simple interface and speed. Is there a mobile app available?
Equiet··on Ask HN: Who is hiring? (July 2015)
Unite - San Francisco, Los Angeles - Full Time - FrontEnd, BackEnd, DevOps - http://unite.io

We're a data startup looking for engineers to join our small and highly skilled team in Los Angeles and San Francisco. We are building powerful online advertising tools that everyone can use — not just big brands and agencies. We are growing incredibly fast, our servers handle 2000 requests per second and manage more than 700 million users (yes, that's 20% of the internet).

We are looking for talented front-end, back-end and dev ops engineers. We use Angular/React/JavaScript (ES6+) on the front end, and Java/Kafka/Storm/Redis/Node on the back end, with servers running on Heroku and AWS.

Feel free to ping me anytime at engineering@unite.io.

Equiet··on Ask HN: Who is hiring? (May 2015)
Unite - San Francisco and Prague - Full time or Interns - http://unite.io

We're a data startup looking for engineers to join our small and highly skilled team in our new office in San Francisco. We are building powerful online advertising tools that everyone can use — not just big brands and agencies. We are growing incredibly fast — our servers handle 2000 requests per second and manage more than 700 million users (yes, that's 20% of the internet).

We are looking for experienced front-end developers and full-stack engineers. We use Angular/JavaScript (ES6) on the front end, and Java/Cassandra/Kafka/Storm/Redis on the back end.

Feel free to ping me anytime at engineering@unite.io.

Equiet··on Ask HN: Who is hiring? (March 2015)
Unite - San Francisco, Toronto, Prague - Full time or Interns - http://unite.io

We're a startup looking for engineers to join our small and highly skilled team in our offices in Toronto and Prague, or a new office in San Francisco. We've built a perfect platform to put the industry’s most powerful advertising technology in the hands of small entrepreneurs and people like you. Our goal is to provide independent sellers with more traffic and better conversion rates to power their online sales.

We are growing incredibly fast — our servers handle 2000 requests per second and manage more than 700 million user profiles (yes, that's 20% of the Internet).

We are looking for experienced front-end developers and full-stack engineers. We use Angular/JavaScript (with almost all ES6 features) on the front end, and Java/Cassandra/Redis/Kafka/Storm on the back end.

Feel free to ping me anytime at engineering@unite.io.

Equiet··on Ask HN: Who is hiring? (February 2015)
Unite - San Francisco - Full time - http://unite.io

We're a stealthy startup looking for engineers to join our small and highly skilled team in our new office in San Francisco. We are building a global data marketplace, with a focus on advertising industry. We are growing incredibly fast — our servers handle 2000 requests per second and manage more than 700 million users (yes, that's 20% of the internet).

We are looking for experienced front-end developers and full-stack engineers. We use Angular/JavaScript (with almost all ES6 features) on the front end, and Java/Cassandra/Kafka/Storm on the back end.

Feel free to ping me anytime at engineering@unite.io.

← PreviousPage 2 of 3Next →