Try every model of Prem

Models status

Anthropic
claude-3-sonnet
100% 38.86
90 days ago Today
claude-3-haiku
99% 73.17
90 days ago Today
claude-3.5-sonnet
99% 33.56
90 days ago Today
claude-3-opus
98% 18.18
90 days ago Today
claude-3.5-sonnet-v2
94% 24.71
90 days ago Today
claude-3.5-haiku
94% 31.26
90 days ago Today
Gpt
gpt-4o-mini-eu
88% 87.91
90 days ago Today
gpt-4-turbo
88% 30.60
90 days ago Today
gpt-4o-mini
88% 52.75
90 days ago Today
gpt-4-eu
88% 23.21
90 days ago Today
gpt-4o
88% 50.72
90 days ago Today
gpt-4o-eu
87% 75.62
90 days ago Today
Llama
llama-3.2-1b
99% 576.03
90 days ago Today
llama-3.2-3b
98% 503.36
90 days ago Today
llama-3.3-70b
94% 165.06
90 days ago Today
llama-3-70b
88% 207.13
90 days ago Today
llama-3-8b
88% 411.11
90 days ago Today
llama-3.1-70b
87% 156.71
90 days ago Today
llama-3.1-8b
87% 331.28
90 days ago Today
llama-3-8b-guard
99% 8.62
90 days ago Today
Mistral
mixtral-8x7b
87% 294.88
90 days ago Today

Models performances

Group
Name
AVG Uptime
AVG t/s
Summarization
Tool use
Hallucination
Anthropic
claude-3.5-haiku
50%
15.68 t/s
63%
70%
5%
Anthropic
claude-3.5-sonnet
50%
16.31 t/s
67%
60%
0%
Anthropic
claude-3.5-sonnet-v2
50%
14.00 t/s
68%
60%
5%
Anthropic
claude-3-haiku
50%
39.58 t/s
70%
70%
5%
Anthropic
claude-3-opus
50%
8.10 t/s
76%
65%
0%
Anthropic
claude-3-sonnet
50%
15.11 t/s
67%
70%
5%
gpt
gpt-4-eu
50%
12.38 t/s
59%
72%
15%
gpt
gpt-4o
50%
18.01 t/s
71%
67%
10%
gpt
gpt-4o-eu
50%
36.96 t/s
73%
83%
0%
gpt
gpt-4o-mini
50%
27.96 t/s
74%
83%
5%
gpt
gpt-4o-mini-eu
50%
55.23 t/s
72%
78%
5%
gpt
gpt-4-turbo
50%
13.80 t/s
73%
72%
5%
llama
llama-3.1-70b
50%
95.05 t/s
65%
95%
0%
llama
llama-3.1-8b
50%
180.84 t/s
62%
88%
10%
llama
llama-3.2-1b
50%
254.15 t/s
45%
Not supported
20%
llama
llama-3.2-3b
50%
258.55 t/s
57%
Not supported
15%
llama
llama-3.3-70b
50%
92.90 t/s
68%
100%
0%
llama
llama-3-70b
50%
113.86 t/s
66%
85%
5%
llama
llama-3-8b
50%
186.09 t/s
64%
89%
5%
llama
llama-3-8b-guard
50%
3.08 t/s
0%
Not supported
100%
mistral
mixtral-8x7b
50%
133.06 t/s
67%
88%
10%