HNHacker News
TopNewBestAskShowJobs

maxma1987

7 karma · joined April 17, 2024

submissionscomments
maxma1987··on Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
We are sorry that we temporarily closed the repo because we were unfamiliar with the code release policy from Meta. We had to re-organize a small part of the code.

Now the repo has been re-opened at https://github.com/XuezheMax/megalodon

The model checkpoint is still under Meta legal review. We will release it once we get approval.