Practice — Local LLM Deployment and Open-Weight Serving (5 questions)

A team is building an internal support-ticket triage feature that will serve roughly 200 concurrent employees during business hours, each sending occasional requests, on infrastructure the team fully controls. Someone proposes Ollama because "it's simple and we already use it on our laptops for testing."

1. Is Ollama a reasonable choice for this production workload? Explain what specifically would or wouldn't scale.
2. Which tool from this subject's stack is the better fit for this workload, and name the two specific techniques that make it a better fit.
3. Would your answer change if this were instead a single internal tool used by one engineer at a time? Explain why or why not.