reasoning
6 posts tagged reasoning, newest first.
Posts
A start-tag search over the whole reply: non-stream reasoning in Xinference
A non-stream chat reply that had no <think> before </think> but mentioned one after it either failed with an HTTP 500 or came back with the wrong reasoning_content.
Checking the new chunk first: a repeated end tag in streamed replies in Xinference
Once a streamed reply's reasoning had ended, a later </think> in the answer was read as the end of the reasoning again.
A start tag inserted ahead of a newline: streamed reasoning in Xinference
A streamed reply that starts with a lone newline chunk, with reasoning_content on, put the model's own <think> inside reasoning_content.
An end index counted from zero: content after a leading newline in Xinference
A non-stream chat reply with a newline before the <think> tag came back with a stray > at the start of content.
A parser branch that assumed no start tag: unfinished replies in Xinference
A non-stream chat reply that stopped inside the thinking block, for example at max_tokens, came back with <think> at the front of reasoning_content.
Four early exits dropped the chunk: empty reasoning streams in Xinference
A streamed chat reply with no text at all, from a reasoning model that needs the <think> tag added, reached the client as data: [DONE] and nothing else.