Match a job Paths Subjects Questions Quizzes Pricing
Overview Read Practice

Practice — Tool and Function Calling (9 questions)

Pro content

Sign up free, then start a 14-day Pro trial — no card needed.

Intermediate Open Free

Redesigning a Tool That Confuses the Model Permalink →

Your team shipped an internal assistant with one tool:

{
  "name": "manage_ticket",
  "description": "Handles ticket operations",
  "parameters": {
    "type": "object",
    "properties": {
      "action": { "type": "string" },
      "data": { "type": "object" }
    },
    "required": ["action"]
  }
}

In evaluation, the model regularly calls it with the wrong action string (e.g. "update" when it meant "close"), and data comes back shaped differently every time, which breaks the handler that parses it.

  1. Explain why this tool's shape is causing exactly these two failure modes.
  2. Redesign it — show the new tool definition(s).
  3. What would you check in evaluation to confirm the redesign actually fixed tool-selection accuracy, not just made the schema prettier?

Share this question

Intermediate Open Pro

Choosing a Tool-Choice Mode for Structured Extraction

Unlock this question →
Intermediate Open Pro

Parallel Tool Calls and a Latency Budget

Unlock this question →
Intermediate Open Pro

What Happens When a Tool Call Fails

Unlock this question →
Intermediate Open Pro

Where the Permission Boundary Actually Lives

Unlock this question →
Intermediate Open Free

What a Tool's Description Field Is Actually For Permalink →

A tool definition sent to the model has three parts: a name, a description, and a JSON-schema parameters object. The model reads all three at inference time before deciding whether to call the tool and, if so, with what arguments — it never sees your source code or your internal docs.

What is the primary role the description field plays in that process?

Share this question

Intermediate Open Pro

Keeping Tools Visible While Blocking a Tool Call

Unlock this question →
Intermediate Open Pro

Retrying a Transient Downstream Failure

Unlock this question →
Intermediate Open Pro

Where Order-Ownership Scoping Actually Has to Live

Unlock this question →

We use cookies for product analytics to improve OmniAtlas. See our Privacy Policy.