Phi-3 Medium
Phi-3 Medium is a compact instruct model aimed at strong quality per parameter for on-device and cost-sensitive cloud inference.
Newer version: Phi-4
Provider
Microsoft
Model family
Microsoft Phi
Small LLM
Cost tier
Medium
Status
Legacy
Release May 21, 2024
Why teams choose it
Complex reasoning
Useful for workflows that require structured thinking, multi-step logic, and deeper analysis than lightweight models provide.
Long-context analysis
Helps teams summarize, compare, and extract insights from long documents without losing important nuance.
Microsoft roadmap vigilance
Use published model pages—not stale marketing blurbs—for modalities, quotas, pricing, and policy; schedule revalidation tied to vendor release notes.
Cost-efficient routing
Useful as part of a routing stack where cheap models handle drafts and confirmations and this tier handles genuinely hard passages.
Tradeoffs to know
- Context window smaller than frontier chat models—design chunking carefully.
- Safety: add moderation for user-generated inputs.
Technical specs
- Inputs
- text
- Outputs
- text
- Capabilities
- on-device, reasoning, coding
- License
- MIT
Benchmarks
No independent or vendor benchmark scores in this catalog entry.
Microsoft Phi family lineup
Current models
Previous versions
Related models
Phi-3 Medium FAQ
What is Phi-3 Medium?
Phi-3 Medium is a compact instruct model aimed at strong quality per parameter for on-device and cost-sensitive cloud inference. It competes with other SLMs on coding and reasoning benchmarks—validate on your domain prompts.
When does Phi-3 Medium fit best?
Laptop-local assistants
What should teams watch out for with Phi-3 Medium?
Context window smaller than frontier chat models—design chunking carefully.
Explore next
Models, tools, and comparisons that connect to this reference.