HNHacker News
TopNewBestAskShowJobs

wsxiaoys

1,499 karma · joined March 30, 2011

meet.hn/city/us-Sunnyvale

Socials: - cal.com/mengzhang - linkedin.com/in/mzh0 - github.com/wsxiaoys

---

submissionscomments
wsxiaoys··on CodeCompose: A large-scale industrial deployment of AI-assisted code authoring
Check out https://github.com/TabbyML/tabby, which is fully self-hostable and comes with niche features.

On M1/M2, it offers a convenient single binary deployment, thanks to Rust. You can find the latest release at https://github.com/TabbyML/tabby/releases/tag/latest

(Disclaimer: I am the author)

wsxiaoys··on CTranslate2: An efficient inference engine for Transformer models
A less hyped inference engine with INT8/FP16 inference supports on both CPU / GPU (cuda).

Model supports list: GPT-2, GPT-J, GPT-NeoX, OPT, BLOOM, LLAMA, T5, WHISPER

( Found this library during my research on alternatives to triton/FasterTransformer in Tabby https://github.com/TabbyML/tabby)

wsxiaoys··on Ask HN: Who is hiring? (May 2023)
TabbyML | Full Stack Engineer / Machine Learning Engineer | REMOTE

Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot.

Project: https://github.com/TabbyML/tabby

Show HN post: https://news.ycombinator.com/item?id=35470915

We have an ambitious roadmap ahead, and we need your help! If you are interested in being an early member of a fast-growing startup team(spoiler: 100% remote , open source , and transparent compensation). Please reach out and apply at https://tabbyml.notion.site/Careers-35b1a77f3d1743d9bae06b7d...

wsxiaoys··on Show HN: TurboPilot: Copilot clone runs code completion LLM on your CPU
Nice work! Added to https://github.com/wsxiaoys/awesome-ai-coding
wsxiaoys··on Show HN: Tabby – A self-hosted GitHub Copilot
Thank you, I was inspired by the brilliant ideas presented in the employer handbooks of Posthog and GitLab, as acknowledged in the career page.
wsxiaoys··on Show HN: Tabby – A self-hosted GitHub Copilot
There it is: https://marketplace.visualstudio.com/items?itemName=TabbyML....
wsxiaoys··on Show HN: Tabby – A self-hosted GitHub Copilot
Thanks, I'm just so into the puns: Tab-by-ML / TabbyML / Tabby
wsxiaoys··on Show HN: Tabby – A self-hosted GitHub Copilot
Linked my replies to others' questions: [1], [2]

[1] https://news.ycombinator.com/item?id=35471882

[2] https://news.ycombinator.com/item?id=35471390

I hope these can be of help and answer your questions as well!

wsxiaoys··on Show HN: Tabby – A self-hosted GitHub Copilot
Tabby's philosophy is to achieve a completion rate comparable to Codex/Copilot by using a model size of less than 1B, with support for BF16/FP16 that reduces VRAM requirements to 2G or less. This may seem impossible, given that the model size is 10 times smaller than that of Codex, but it is definitely achievable, especially in an on-premises environment where customers want to keep the code behind a firewall.

Related research works include [1]. (Hints: combine code search and LLM).

[1]: RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation https://arxiv.org/abs/2303.12570

This also reveals Tabby's roadmap beyond other OSS work like Fauxipilot :)

wsxiaoys··on Show HN: Tabby – A self-hosted GitHub Copilot
Tabby is tested against various open-source models based on GPT-J/GPT-NeoX, including https://huggingface.co/CarperAI/FIM-NeoX-1.3B and https://huggingface.co/Salesforce/codegen-350M-multi.

In the meantime, I'm training language-specific base models using NeoX blocks. I hope to release them soon.

The Huggingface Space demo is running on a derived model of Salesforce/codegen-350M-multi

wsxiaoys··on Show HN: Tabby – A self-hosted GitHub Copilot
Tabby collected the source code from the related repository and built them into a dataset. I already have some proof-of-concept pipelines built [1] and [2], but I still need some time to polish the data pipeline..

[1]: https://github.com/TabbyML/tabby/blob/main/tabby/tools/repos...

[2]: https://github.com/TabbyML/tabby/blob/main/tabby/tools/train...

wsxiaoys··on Show HN: ChatIDE – DIY Github Copilot X
Added you both (ChatIDE / PromptMate) to my ai coding awesome list :)

https://github.com/wsxiaoys/awesome-ai-coding

wsxiaoys··on Open Sourcing Cody – Sourcegraph's AI-enabled editor assistant
That‘ll be super interesting!

Local context is definitely the key factor for small models achieving better quality than copilot (related: [1], [2]) .

One things I’d really wanna have in Sourcegraph: A Search API supports custom retrieval / ranking. Research works (e.g [2]) show simple BoW fetched context is more efficient for code completion tasks.

Disclaimer: I’m building https://github.com/TabbyML/tabby an open source alternative of copilot.

[1]: https://arxiv.org/abs/2206.12839

[2]: https://arxiv.org/abs/2303.12570

wsxiaoys··on Open Sourcing Cody – Sourcegraph's AI-enabled editor assistant
Thanks, I'm just so into the puns: Tab-by-ML / TabbyML / Tabby
wsxiaoys··on Open Sourcing Cody – Sourcegraph's AI-enabled editor assistant
Cody is more like a wrapper on top of GPT API (gpt-3.5-turbo) endpoint, with related code snippets embed in prompt. It’s not competing the low latency scenario that Github Copilot seats in.

There’re recent works show a potential of beating Copilot’s performance (e.g https://arxiv.org/abs/2303.12570) with much smaller models (500M vs 10B+).

Inspired by these work, I’m building Tabby (https://github.com/TabbyML/tabby), a OSS GitHub Copilot alternative. Hopefully it could make low cost AI coding accessible to everyone.

wsxiaoys··on CodeAlpaca – Instruction following code generation model
https://github.com/wsxiaoys/awesome-ai-coding

Great time to start an awesome AI coding list!

wsxiaoys··on Show HN: I made a self-hosted code search and explanation with AI
I indexed a few opensource project to demonstrate:

flask: https://quick-question.fly.dev/pallets/flask

diffusers: https://quick-question.fly.dev/huggingface/diffusers

wsxiaoys··on Show HN: WebGL Ray-Tracing for product packshots (Desktop Only)
instashot is a virtual photography studio for product photos creation with 3D model.

underlying it's powered by Next.JS / R3F / ThreeJS / WebGL PathTracing

wsxiaoys··on A shared Posix file system built on top of Redis and S3
JuiceFS is the missing piece of ML eco around MLFlow / JupyterHub. We deployed it as researcher's primary storage solution as it perfectly scale a traditional linux (uid/gid based acl) experiece to cloud OSS.

Highly recommend to any team wanna build their internal machine learning platform on cloud.

wsxiaoys··on Ask HN: What language/framework you thought was the future but ended up dying?
NaCL:https://developer.chrome.com/native-client/nacl-and-pnacl
wsxiaoys··on Google Coral Edge TPU
TPU in Colab is not the same device as edge TPU.
wsxiaoys··on Show HN: Stock Screener and Portfolio Management for DIY Equity Investors
Congrats for the launch! I tried a large number of portfolio management options and end up using gSheet, listing some features most solutions missed:

1. Slot based positions instead of ticker based.

2. Cash management.

3. Performance tracking based on actual asset rather than latest asset.

wsxiaoys··on GitHub is used for anti-censorship on Peking University student's protesting
Context: https://supchina.com/2018/04/23/beida-student-to-school-stop...

Suggestions for title welcome

wsxiaoys··on A decentralised Universal Basic Income platform based on personal currencies
This is much like an IOU system (for example: http://settle.network) , but with automatic money generation (mining).
wsxiaoys··on Show HN: Datasette – Create and publish an API for SQLite databases
Congrats for the launch! I was searching for such tool exact yesterday:)

I understand the benefits of Immutable pattern, but it'll be nice if datasettle could provide interface with single non-frequent writer(for example, most FRED data is updated seasonally, some of them updates daily) so the pipeline pulling data from some source could be automated

wsxiaoys··on Tell HN: Yahoo Finance has apparently killed its API
Thanks for building this! I noticed that the charting api have EOD prices for past 5 years, is there a plan to support longer durations?
wsxiaoys··on Near Future of Programming Languages [pdf]
Nope.
wsxiaoys··on Near Future of Programming Languages [pdf]
In case of anyone interested a reasonable engineered language that supports Closure Serialization (mentioned as "hard" in last slide), checkout:

Gambit Scheme: A fast scheme implementation. http://github.com/gambit/gambit

Gerbil Scheme: Provides full module and syntactic tower on top of Gambit Scheme. https://github.com/vyzo/gerbil

wsxiaoys··on Ask HN: What is your favorite CS paper?
Cheney on the MTA http://home.pipeline.com/~hbaker1/CheneyMTA.html

Full tail recursion scheme implementation by never "return" in C

wsxiaoys··on Show HN: Is the stock market going to crash?
Just found its repository here: https://github.com/effinggames/financial-charts
← PreviousPage 2 of 4Next →