jwitthuhn

I've made a tiny ~1m parameter model that can generate random Magic the Gathering cards that is largely based on Karpathy's nanogpt with a few more features added on top.

I don't have a pre-trained model to share but you can make one yourself from the git repo, assuming you have an apple silicon mac.

https://github.com/jlwitthuhn/TCGGPT

In general you can just use the parameter count to figure that out.

70B model at 8 bits per parameter would mean 70GB, 4 bits is 35GB, etc. But that is just for the raw weights, you also need some ram to store the data that is passing through the model and the OS eats up some, so add about a 10-15% buffer on top of that to make sure you're good.

Also the quality falls off pretty quick once you start quantizing below 4-bit so be careful with that, but at 3-bit a 70B model should run fine on 32GB of ram.

For me it is consistency. I control the model and the software so I know a local LLM will remain exactly the same until I want to change it.

It also avoids the trouble of using a hosted LLM that decides to double their price overnight, costs are very predictable.

For anyone else looking for the weights which as far as I can tell are not linked in the article:

Base model: https://huggingface.co/Zyphra/Zamba2-7B

Instruct tuned: https://huggingface.co/Zyphra/Zamba2-7B-Instruct

Looking forward to them taking a similar action against Wordpress.com for upselling access to the core wordpress feature of plugins.

I'm no trademark lawyer, but isn't offering "WordPress" hosting fine as long as you are genuinely using the WordPress software? As I understand it that is purely nominative use.

I see that sentiment largely coming from developers who, I think, misunderstand the freedom that the GPL is protecting.

The GPL focuses on the user's freedom to modify any software they are using to better suit their own needs, and it does a great job of it.

The people saying that it is less free than bsd/mit/apache are looking at it from a developer's perspective. The GPL does deliberately limit a developer's freedom to include GPL code in a proprietary product, because that would restrict the user's freedom to modify the code.

As I understand it the sanctioned way of sharing code added to UE is to fork it on github and publish changes to your fork.

Being a fork it will only be available to other people in the Epic Games github org which is only people who have agreed to Epic's licensing terms, and your modified engine remains under that same license.

Yeah, you need to manually fix each affected system by booting in safe mode. Not possible to do remotely.

For anyone who wants a sneak peak at what the content will be, Andrej Karpathy already has a series on videos on youtube that covers roughly the first half of the list here: https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxb...

Starts with building micrograd to build an understanding of how pytorch understands how to calculate gradients, then it proceeds all the way to making a gpt-2 clone.

Looks like this is an effort to reorganize and build on that existing work.

I have to disagree that I'm perpetuating any falsehood here. Mozilla literally needs to approve an addon for it to behave normally. That you are satisfied with the process they have for approving doesn't change that.

To me it seems absurd for a company that claims to be so pro-privacy to not allow any genuinely private extensions to exist. Anyone who wants to make a 'real' addon has to share their code with mozilla.

The extension needs to be signed by mozilla for the normal production builds of firefox to let you load it on startup. If it isn't signed, you need to manually load it in using about:debugging each time you restart firefox.

I'm not aware of any other openly-licensed model of comparable size to 54b. That seems like a worthwhile addition to what is already available, imo.

The closest is mixtral 8x7b but that one only uses a fraction of its parameters for each pass. This one should produce better but slower results at roughly the same memory requirement.

It is ~260GB with presumably fp16 weights. Should fit into 64GB at 3-bit quantization (~49GB).

Edit: To add to this, I've had good luck getting solid output out of mixtral 8x7b at 3-bit, so that isn't small enough to completely kill the model's quality.

Not even iframes, by my memory it was regular frames (rip).

One frame at the top with a banner ad and then your site below it.

Is this still available somewhere? I attempted to download it several months ago and saw the download link 404ing, seems it is still like that.

Don't see it mentioned in the post, can any of these problems exist for models in the safetensors format? Can't say I know enough about model serialization to understand exactly how much safer it is.

Everything you type in the start menu gets sent to microsoft by default and this can only be changed with Group Policy, so anyone on home edition is stuck with that.

The SSPL is notable in that it effectively forbids hosting the software to be used by other people.

To comply you must provide 'the Corresponding Source for the Program or the modified version, and the Corresponding Source for all programs that you use to make the Program or modified version available as a service'

A plain reading of this means that for a standard web app you would need to release not just the application code, but also code for the web server you are using, the os you are using, its drivers, device firmware, the os/firmware for your routers, your deployment stack, and probably more I'm missing. You better not trigger a deployment from a Windows computer using Chrome!

Even if I'm using open-source stuff for all of that it would need to have licenses compatible with SSPL such that I can relicense and release them all under the SSPL. I believe GPL is incompatible so that counts out most software I would use to host a webapp.

To me it seems like a fundamentally unreasonable license because for all practical purposes it is entirely impossible to comply with section 13.

So you're telling me that he is going to be Mr. Manager at OpenAI?

It is somewhat awkward to use because, at least the last time I checked, you need to purchase a wwise license for audio to work.

Is this a new thing? I installed windows 11 fresh about a year ago and it did not force me (or to my memory, even offer) to use bitlocker during setup.

You have to check a box in the installer to pinky swear you do have a license, but it isn't validated in any way.

As I understand it manufacturing your own firearms is explicitly legal in the US. This isn't a loophole, it is another politician who simply wants to disarm the working class.

Agreed, the worst outcome here is the little guy getting funny ideas about being able to freely access information. We need to keep it locked up so our betters can decide what the most appropriate use is.

Even though the walked back the price change this time, Unity still contends that they have the authority to increase the price and apply that price increase to old versions even if the users don't agree [1].

Unreal lets users stick to a license with predictable fees.

By using Unity you are still agreeing to a liability with no limit that can change at any time and your only recourse is to cease development or stop selling your already-complete game.

1. https://forum.unity.com/threads/unity-plan-pricing-and-packa...

That is the size of 'The Pile' which contains books3 among many other things.

This bit me the first time I deployed using docker.

Everything but 80/443 blocked by the firewall. "Surely it is safe to run my app server on port 8000 because no one can access that port externally."

Docker stepped in to help by making sure people could access that port.

They are probably just repeating facebook's ridiculous claim that it is open source. The header of the release announcement is "The next generation of our open source large language model"

> The process of replicating RHEL is so much easier today than ever before.

I would argue that it was easier a few weeks ago when they made source rpms available publicly.