LLM Models List
| Name | License | Params | Context | Access | Cost | Score | ARC | MMLU | GSM8K | Updated | Actions |
|---|---|---|---|---|---|---|---|---|---|---|---|
Claude 3.5 Anthropic | Proprietary | ~400B | 400,000 tokens | API | $0.012/1K tokens | 95.50 | 96.00 | 94.40 | 96.30 | 2024-01-10 | View Details |
Gemini Ultra Google | Proprietary | ~500B | 128,000 tokens | API | $0.015/1K tokens | 94.80 | 95.20 | 94.90 | 94.30 | 2024-01-05 | View Details |
LLaMA 3 Meta | Open Source | 400B | 128,000 tokens | Open Source | Free | 93.50 | 94.00 | 92.40 | 94.30 | 2024-01-02 | View Details |
Grok-2 xAI | Proprietary | 314B | 300,000 tokens | API | Subscription based | 92.50 | 93.00 | 92.40 | 92.10 | 2024-01-01 | View Details |
Mixtral 8x7B Mistral AI | Apache 2.0 | 47B | 32,000 tokens | Open Source | Free | 91.80 | 92.50 | 91.20 | 91.70 | 2023-12-15 | View Details |
GPT-4 Turbo OpenAI | Proprietary | ~1.8T | 128,000 tokens | API | $0.01/1K tokens | 90.50 | 92.00 | 86.40 | 92.30 | 2024-01-11 | View Details |
Mixtral 8x7B Instruct Mistral AI | Apache 2.0 | 47B | 32,000 tokens | Open Source | Free | 87.00 | 88.50 | 85.80 | 87.70 | 2024-01-08 | View Details |
LLaMA 2 70B Meta | Open Source | 70B | 4,000 tokens | Open Source | Free | 85.50 | 86.20 | 83.10 | 87.20 | 2023-07-18 | View Details |
GPT-4 OpenAI | Proprietary | ~1.8T | 8,000 tokens | API | $0.03/1K tokens | 89.80 | 91.00 | 86.40 | 92.00 | 2023-11-11 | View Details |
Claude Instant Anthropic | Proprietary | ~40B | 100,000 tokens | API | $0.002/1K tokens | 84.50 | 84.00 | 82.50 | 87.00 | 2023-12-21 | View Details |
Mistral 7B Mistral AI | Apache 2.0 | 7B | 32,000 tokens | Open Source | Free | 83.50 | 83.00 | 81.50 | 86.00 | 2023-09-27 | View Details |
PaLM 2 Google | Proprietary | 340B | 8,000 tokens | API | $0.005/1K tokens | 83.00 | 82.50 | 81.00 | 85.50 | 2023-05-10 | View Details |
Yi 34B 01.AI | Apache 2.0 | 34B | 4,000 tokens | Open Source | Free | 82.50 | 82.00 | 80.50 | 85.00 | 2023-11-23 | View Details |
Qwen 72B Alibaba | Open Source | 72B | 32,000 tokens | Open Source | Free | 82.00 | 81.50 | 80.00 | 84.50 | 2023-11-30 | View Details |
GPT-3.5 Turbo OpenAI | Proprietary | ~175B | 16,000 tokens | API | $0.001/1K tokens | 81.50 | 81.00 | 79.50 | 84.00 | 2023-11-11 | View Details |
LLaMA 2 13B Meta | Open Source | 13B | 4,000 tokens | Open Source | Free | 81.00 | 80.50 | 79.00 | 83.50 | 2023-07-18 | View Details |
Falcon 180B TII | Apache 2.0 | 180B | 4,000 tokens | Open Source | Free | 80.50 | 80.00 | 78.50 | 83.00 | 2023-09-20 | View Details |
Vicuna 13B LMSYS | Open Source | 13B | 4,000 tokens | Open Source | Free | 80.00 | 79.50 | 78.00 | 82.50 | 2023-08-28 | View Details |
Phi-2 Microsoft | MIT | 2.7B | 4,000 tokens | Open Source | Free | 79.50 | 79.00 | 77.50 | 82.00 | 2023-12-15 | View Details |
MPT 30B MosaicML | Apache 2.0 | 30B | 8,000 tokens | Open Source | Free | 79.00 | 78.50 | 77.00 | 81.50 | 2023-05-05 | View Details |
Command Cohere | Proprietary | ~100B | 32,000 tokens | API | $0.015/1K tokens | 78.50 | 78.00 | 76.50 | 81.00 | 2023-11-30 | View Details |
StableLM Zephyr Stability AI | Apache 2.0 | 3B | 4,000 tokens | Open Source | Free | 78.00 | 77.50 | 76.00 | 80.50 | 2023-11-28 | View Details |
BLOOMZ 7B1 Hugging Face | Open Source | 7B | 2,000 tokens | Open Source | Free | 77.50 | 77.00 | 75.50 | 80.00 | 2023-04-25 | View Details |
DeepSeek Coder DeepSeek | Apache 2.0 | 33B | 16,000 tokens | Open Source | Free | 77.00 | 76.50 | 75.00 | 79.50 | 2023-11-20 | View Details |
Mixtral 8x7B Mistral AI | Apache 2.0 | 47B | 32,000 tokens | Open Source | Free | 76.50 | 76.00 | 74.50 | 79.00 | 2023-12-08 | View Details |
OpenChat 3.5 Openchat AI | Apache 2.0 | 7B | 8,000 tokens | Open Source | Free | 76.00 | 75.50 | 74.00 | 78.50 | 2023-12-01 | View Details |
Solar 10.7B Upstage | Apache 2.0 | 10.7B | 4,000 tokens | Open Source | Free | 75.50 | 75.00 | 73.50 | 78.00 | 2023-11-15 | View Details |
Xwin-LM 70B Xwin-LM | Apache 2.0 | 70B | 16,000 tokens | Open Source | Free | 75.00 | 74.50 | 73.00 | 77.50 | 2023-11-25 | View Details |
Zephyr 7B Hugging Face | Apache 2.0 | 7B | 8,000 tokens | Open Source | Free | 74.50 | 74.00 | 72.50 | 77.00 | 2023-11-10 | View Details |
Yi 34B Chat 01.AI | Apache 2.0 | 34B | 16,000 tokens | Open Source | Free | 74.00 | 73.50 | 72.00 | 76.50 | 2023-11-30 | View Details |
Starling-LM 7B Berkeley | Apache 2.0 | 7B | 8,000 tokens | Open Source | Free | 73.50 | 73.00 | 71.50 | 76.00 | 2023-11-05 | View Details |
Nous Hermes 2 Nous Research | Apache 2.0 | 70B | 4,000 tokens | Open Source | Free | 73.00 | 72.50 | 71.00 | 75.50 | 2023-11-01 | View Details |
Gemini Pro Google | Proprietary | Unknown | 32,000 tokens | API | $0.0010/1K tokens | 72.50 | 72.00 | 70.50 | 75.00 | 2023-12-06 | View Details |