Hacker News Reader

Do they have an API where you can control the chat template or at least just put everything in the system prompt? This way you can control everything including the tool calling syntax. Even if you use the trained tool syntax, it allows you to control the tool system prompt which you may want to tweak. With DeepSeek this is all possible. An undocumented feature, great for harness builders. Anybody got info on Qwen regarding this?

View on HN

Can't you do that on OpenRouter? You can set a system prompt there. Is that insufficient for what you had in mind?

They are talking about the chat template and not the system prompt. With current gen models, the system prompt is only part of a larger pretext that is passed to the model at the start of the "chat". The models are trained on a specific chat template with things like tool lists, reasoning budget, special feature flags and the "system prompt" formatted in a certain template.

Reply on news.ycombinator.com