Hacker News Reader

I have been waiting for this, and now that it is finally here, it genuinely feels like Christmas.

AI bridged the gap between my wildest ideas and my present capabilities. It took some time to figure out how to use it efficiently with the 8K token limit, but once I did, I was able to break down any problem into small enough parts for GPT.

The quadrupled context window changes everything. I cannot wait to continue building. I am vibrating with excitement.

View on HN

I have no idea what you said, could you perhaps elaborate on some sample ideas this tool helped you and what is the 8K token limit and why was it limiting you? Does that 8K limit, limit your context length, i.e. history you have per chat thread with the tool?

> Does that 8K limit, limit your context length, i.e. history you have per chat thread with the tool?

Yes, the token limit for an LLM limits the combination of the prompt (which normally includes the whole conversation history, as the LLM itself has no memory) and response.

There's tricks to have a longer conversation without completely forgetting the past (summarization, offloading parts to a database, usually indexed by embedding vectors, and using search to recall relevant history, etc.) but the base case is everything has to fit into context.

Reply on news.ycombinator.com