HNHacker News
TopNewBestAskShowJobs

jncraton

1,424 karma · joined June 1, 2008

I'm always interested in new ideas. Feel free to get in touch.

https://joncraton.com

my username [at] g m a i l

submissionscomments
jncraton··on New and Improved Embedding Model for OpenAI
You can use any sort of natural language text as input. The system transforms the input text into a multidimensional vector that roughly represents the semantic meaning of the input.

If you do this for many different inputs, you can get representations for each of them and store them in a database alongside the inputs. From there, you can use traditional methods to search for nearby vectors to efficiently search by semantic meaning.

One earlier related example is word2vec from 2013. This tool transforms individual words into embeddings, but is conceptually similar. Wikipedia has a decent overview that might be helpful:

https://en.wikipedia.org/wiki/Word2vec

That work demonstrated the utility of transforming meaning into vector space for search but also for basic semantic reasoning. For example, you could perform an operation like "brother - man + woman" on the embedding and the result would be an embedding very close to "sister".

jncraton··on How does GPT obtain its ability? Tracing emergent abilities of language models
Correct. That concept is the chain of thought (CoT) reasoning that the article discusses.
jncraton··on Why hasn’t technology disrupted higher education already?
I believe clarifying things immediately and succinctly may be why the author mentioned LLMs. They have the potential to provide this sort of feedback. They are obviously imperfect, but for the sort of questions that many undergraduates get stuck on (code won't compile due to a missing semicolon, etc) they are already a great asset.
jncraton··on Musk’s Boring Company Ghosts Cities Across America
https://archive.ph/mMXqb
jncraton··on GPT-3 can create both sides of an Interactive Fiction transcript
There are smaller models that you can freely play around with that work in roughly the same way. If you're working on a fairly regular computer some reasonable options are GPT2 or GPT-Neo. These can both perform inference on your local CPU if you have 8GB or more of RAM.

They are much less powerful that GPT-3, but they can still be fun for simple text generation or NLP tasks. You can play around with one of the smaller GPT-Neo models that should fit in RAM if run locally here:

https://huggingface.co/EleutherAI/gpt-neo-1.3B

That page includes instructions to run this locally in Python.

As others mentioned, there are larger models available, but they tend to be expensive to setup and use as an individual.

jncraton··on Fighting JPEG color banding
Guetzli was already mentioned and roughly does what you are talking about.

MozJPEG [1] includes several quantization tables that are optimized for different contexts (see the quant-table flag and source code for specific tables[2]), and the default quantization table has been optimized to outperform the recommended quantization tables in the original JPEG spec (Annex K).

It's also worth noting that MozJPEG uses Trellis quantization [3] to help improve quality without a per-image quantization table search. Basically rather than determining an optimal quantization table for the image, it minimizes rate distortion on a per-block level by tuning the quantized coefficients.

Both the SSIM and PSNR tuned quantization tables (2 and 4) provided by MozJPEG use a lower value in the first position of the quantization just like this article suggests (9 and 12 vs the libjpeg default of 16).

[1] https://github.com/mozilla/mozjpeg

[2] https://github.com/mozilla/mozjpeg/blob/5c6a0f0971edf1ed3cf3...

[3] https://en.wikipedia.org/wiki/Trellis_quantization

jncraton··on Turning a 1995 IBM Aptiva, 66mhz 486DX2, into an i7 6700k
You can also perform transfers like this using crossover or null modem[1] serial cables if both machines have serial ports. I transferred a number of files like this back in the day.

You could even use them for some multiplayer games that would have otherwise required a proper LAN.

[1] https://en.wikipedia.org/wiki/Null_modem

jncraton··on That Magical Word: Workstation
The following generation machine (8770w) is my daily driver at home. If anyone else is thinking about getting a laptop like this, I maintain a little site that sifts through, cleans up, and sorts the current eBay listings:

https://createdtolast.com/laptops

Select "workstation" from the size drop down to see only 17 inch machines.

jncraton··on Show HN: OurBoard – free and open source online whiteboard
Thanks! The goal is simplicity, so it doesn't attempt feature parity with a more comprehensive tool like yours. Collaboration features, along with any features that can't be implemented on simple static hosting, are out of scope.

I really like the collaborative nature of what you've built. I can definitely imagine using this in meetings or group planning sessions.

jncraton··on Show HN: OurBoard – free and open source online whiteboard
This looks great. Thanks for sharing!

If folks are interested in this sort of thing, I also maintain an extremely minimalist open source whiteboarding tool:

https://github.com/jncraton/box-line-text

jncraton··on Nano98: Windows 98 that boots and runs under 5MB (2003)
When I was in high school, I had a specialized CD like this. The computers in our labs were configured to prevent us from running arbitrary programs, but they weren't configured to prevent booting from a CD.

I created a stripped down Windows 95 live CD that had the default shell replaced by StarCraft. I could sit down at a machine, insert my CD, reboot, and the machine would boot directly into SC.

jncraton··on Regularization is all you need: simple neural nets can excel on tabular data
They are the same concept under the hood, but a GBDT is an ensemble model using a number of trees in tandem that are grown to improve the performance of the overall model.
jncraton··on A Generative Grammar for Jazz Chord Sequences (1984)
If you're interested in this sort of grammar application, I created a project a while back that uses a generative grammar to connect LEGO bricks into models:

https://github.com/jncraton/connectiongrammar

jncraton··on Rebrickable – Build with Lego
I've been using Rebrickable for around 8 years, and I've shared over 70 of my creations there, so I wanted to share some of the things I've appreciated about the site beyond the core features of being able to rebuild LEGO sets into new things, manage LEGO inventory, and share creations.

1. The community. I've shared a fairly large amount of content (some of it of pretty low quality), and I've always received positive feedback or tactfully worded constructive feedback. I've yet to see a negative comment on my work. It's a community of folks hanging out sharing their hobby together.

2. The set inventories. The community works hard to keep these up-to-date. I've found them to be very reliable. These are all freely available for download as well. This is a godsend to folks like me who prefer their LEGO inventory to be in a local database they can query.

3. The business model. Most features are available for free in an ad-supported manner, but users can pay for premium features and the removal of ads.

jncraton··on YouTube-dl has received a DMCA takedown from RIAA
Correct. Distributing and developing illegal software (as RIAA has declared youtube-dl to be) is a solved problem technically.

I'd like to see a case surrounding software like this actually defended in a court, though. It would be helpful to clarify what is legal and what is not on the modern Internet in terms of fair use and time shifting.

jncraton··on YouTube-dl has received a DMCA takedown from RIAA
> The file sharing cases of the early 2000's have drawn some lines around the noninfringing use defense, though. Napster and Grokster both claimed, in court, to support noninfringing uses. However, both products promoted their products as offering free access to copyright-protected works, and the courts took notice of that in both cases-- I believe that the Grokster opinion may have noted that Grokster had never mentioned a noninfringing use outside the trial.

That's an excellent point. It seems like youtube-dl may have started as a tool primarily used for ripping music off YouTube, but it has grown into a tool that is used for so much more than that today (offline viewing of content, backups of freely licensed material, fair use such as extracting clips from videos, etc).

Given that no one is getting sued over this, at least not yet, perhaps it makes sense to not fight this and simply allow youtube-dl as it stands to be pulled and re-imagined as a new piece of software that is explicitly focused on the positive and legal use cases. If RIAA still wants to go after that software, the case against it would be far weaker than the current product that has "YouTube" in the name and explicitly references ripping copyrighted music in its source code.

jncraton··on Amazon’s Project Kuiper is more than the company’s response to SpaceX
I shouldn't have said that it isn't a big deal these days, as that devalues the scope of the achievement of getting a payload to orbit. I simply mean that orbital flight is something that we are able to do with the proper funding and resources.

I still think that Bezos can do it if he wants to. If SpaceX were for sale, Bezos could buy them 5 times over (as of their valuation based on their February funding). I have to believe that level of capital could build a company with similar capabilities.

SpaceX has done, and continues to do, incredible work, but their success isn't magical, and it should be repeatable for another company.

jncraton··on Amazon’s Project Kuiper is more than the company’s response to SpaceX
I don't fully understand the negativity around BO. They haven't gone to orbit yet, and they don't run everything they do as a PR campaign the way that SpaceX does, but getting a rocket to orbit isn't that big of a deal these days.

We first achieved orbital flight over 50 years ago, and many different groups have achieved the same since then. Given Bezos' deep pockets, why would BO fail where so many other have succeeded in launching payloads to orbit?

They appear to be making steady progress, both on reusability and on their BE-4 engine. There doesn't appear to be any real insurmountable obstacles between where they are today and orbital flight.

I'm not saying they will absolutely succeed, but their success feels more like a when than an if unless Bezos decides to pull the plug for some reason. Whether they can do this by 2026 is of course a different matter.

jncraton··on We bought Walmart’s $140 laptop so you wouldn’t have to
Thanks! Hopefully I'll get some time to add that at some point. LabGopher provides something similar for servers but with more advanced filtering:

https://www.labgopher.com/

jncraton··on We bought Walmart’s $140 laptop so you wouldn’t have to
I have a site that churns through the eBay API and dumps cheap but durable used laptops here:

https://createdtolast.com/laptops

It saves me time when friends/family ask me for used laptop recommendations, and the eBay referral program nets me some beer money on the side.

jncraton··on Show HN: Box Line Text – A simple whiteboarding tool for screencasts
I appreciate that you took the time to look at the code. I like the app itself well enough, but I especially like that it's just 100 lines of HTML/CSS/JS.

Thanks for sharing excalidraw as well. That looks great.

jncraton··on Show HN: Box Line Text – A simple whiteboarding tool for screencasts
It's certainly helpful to see more of the great tools in this space, and I appreciate you sharing those.

I prefer collaborative editing for meetings as well, but my use case for this is more academic. I'm using it as a stand-in for a board that I'd usually use at the front of the classroom to make a quick diagrams or notes during a lecture, so collaboration isn't especially important to me. I simply wanted something clean and distraction-free.

It'd be sweet to add collaboration to this, but that's obviously an order of magnitude more complicated than what I've built. Perhaps I'll get around to it eventually.

jncraton··on Show HN: Box Line Text – A simple whiteboarding tool for screencasts
Thanks! I enjoyed the challenge of keeping this lean. It's fun to build a web app where the favicon is the bulk of the bytes on the wire. :)
jncraton··on Show HN: Box Line Text – A simple whiteboarding tool for screencasts
I like that idea. I've changed to using shift for deletion. I've also enabled deleting on both mouse clicks and movement, so you can hold down shift and wiggle the mouse around like an eraser. This makes it much easier to delete lines.
jncraton··on Show HN: Box Line Text – A simple whiteboarding tool for screencasts
Deleting is definitely the feature I'd most like to have.

I don't generally love the idea of taking over right click behavior, but I've pushed out a patch to allow removing elements using right click. This is an admittedly poor solution (especially for lines, as they are very small click targets). Hopefully I'll have a chance to develop a more robust way to delete elements such as the box method that you described.

jncraton··on Brunsli: Practical JPEG repacker (now part of JPEG XL)
Does anyone know how this compares to other projects such as Lepton?

https://github.com/dropbox/lepton

The goals and results appear similar. Is the primary difference that brunsli will likely actually be part of a standard (JPEG XL)?

jncraton··on We need to take CO2 out of the sky – an overview of climate tech
I'm glad to see this as well. I've been working on a site as part of a class project to help surface used items that have a long useful lifetime. My hope is that this will help in a small way to reduce the cycle of consumerism.

Here's a link to the site:

https://createdtolast.com/laptops

jncraton··on DuckDuckGo Traffic
Exactly. I like to do this for both speed and privacy.

You can even use DDG bangs as your keywords. I do this for the bangs that I use most frequently (e.g. !w) for both reduced latency and increased privacy. This means I keep the muscle memory for using bangs on other folks machines, but I still get improved privacy and speed on devices that have my bookmarks synced.

jncraton··on Lego to open 160 new stores as other toy retailers suffer
You aren't wrong, but the two are tightly related. LEGO's competitors are also selling many licensed products, but LEGO's position as the best quality brand in the market has allowed them to secure contracts for the most popular IP (Star Wars, Marvel, Minecraft, etc). Their competitors are left with less popular or less family-friendly IP such as Halo or Star Trek.

Its also worth noting that some of LEGO's competitors don't worry too much about IP laws. You can buy a clone brand X-wing for 50% of the cost of the genuine set, but the quality is significantly lower in my experience.

jncraton··on Lego to open 160 new stores as other toy retailers suffer
I'm not saying nothing else survives. Mega Bloks have been around for 30 years and are still filling their market niche well as far as I know. I'm simply saying that quality has been what sets LEGO apart from its competitors. They make great products and target wealthier populations. Their prices (and likely also margins) are higher than their competitors. They're basically the Apple of toys.
← PreviousPage 2 of 8Next →