Show HN: New tool for visualizing embeddings of ChatGPT Q&A

chatgpt-viz.vercel.app

13 points·wakahiu··4 comments

To demonstrate the power of vector embeddings, we built a visualization tool that lets you visualize question and answer pairs that you submit. The tool queries the GPT API to generate the embedding, performs dimensionality reduction using UMAP, and displays the result in 3D alongside other user-submitted questions and answers. You can select clusters of points to understand how ChatGPT associates different questions and answers, as well as select them individually.

Appreciate the feedback.

To clarify, am I supposed to bring across my own question and answer prompt from the ChatGPT app? Is there a way I can just type my question in here directly and get the answer as well as the vector embedding?

You provide both the prompt and response from ChatGPT. Our tool will then query the GPT API to retrieve the vector embeddings that corresponds to your question and answer, map them to lower dimensions and the display the result.

Ok understood. One piece of feedback from me then is that it would be cool if you could reduce friction there and let users directly submit their question to ChatGPT through your form. Not sure if they have API endpoints for that or not.

I'm used to seeing tighter clusters generated by UMAP. Any thought to why the data is pretty dispersed here? Limited data size maybe?

Reply on news.ycombinator.com