Practice — Reasoning Models and Inference-Time Scaling (5 questions)
Advanced
Open
Free
Is This Actually a Reasoning Model, or Just a Good CoT Prompt? Permalink →
A teammate demos a support-escalation classifier: given a ticket, it
outputs a reasoning field (a paragraph of "step by step" analysis)
followed by an escalate: true/false field. They call it "our
reasoning model." The underlying API is a standard (non-thinking)
chat model with a system prompt that says "think step by step in the
reasoning field before deciding."
- Is this actually a reasoning model in the sense this subject uses the term? Justify your answer mechanically, not just semantically.
- Name one concrete behavioral difference you would expect to see if this same task were run on a true reasoning model (e.g. extended thinking or an o-series-style model) instead.
- Give one condition under which switching to a true reasoning model for this specific task would not be worth the extra cost, using this subject's decision framework.
Share this question
Advanced
Open
Pro
Self-Refinement Loop or Tree Search for a Contract-Clause Rewriter?
Unlock this question →
Advanced
Open
Pro