Skip to main content

Phi 3

Phi-3 is a state of the art, lightweight model. It performs exceptionally well despite being half the size of Llama-3 8B. It is highly capable of being an on-device agentic LLM.

note
ModelParamsContext LengthGQAToken CountKnowledge Cutoff
Phi-3 Mini 128k Instruct3.8B128,000Yes3.3TOctober 2023

Phi-3 Mini 128k Instruct

ModelFunction CallingMMLUGPQAGSM-8KMATHMT-benchMT-bench Pairwise Comparison
WinLossTieWin RateLoss RateAdjusted Win Rate
Phi-3 Mini 128k Instruct-69.3627.0183.732.928.022172670.131250.450000.340625
Rubra Enhanced Phi-3 Mini 128k Instruct70.0%67.8729.6979.4530.80 8.217221670.450000.131250.659375
  • The above is based on the Phi-3 Mini that was updated by Microsoft in June 2024. The original Phi-3 mini came out in April and the Rubra enhanced model has been trained on both versions