All Supported Models

29681 AI models · 198875 quantization formats tracked

C

Cortexso

52 models

athene

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

aya

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

aya-expanse

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

codestral

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

cogito-v1

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

command-r

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

deepscaler

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

deepseek-r1

671B 8K ctx
Q2_0
209.69GB file 222.68GB
Q3_0
293.56GB file 306.55GB
Q4_0
377.44GB file 390.43GB
Q5_0
461.31GB file 474.3GB
Q6_0
545.19GB file 558.18GB
Q8_0
712.94GB file 725.93GB

deepseek-r1-distill-llama-70b

70B 8K ctx
Q4_0
39.38GB file 42.53GB
FP16
140GB file 143.15GB

deepseek-r1-distill-llama-8b

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

deepseek-r1-distill-qwen-1.5b

1.5B 8K ctx
Q2_0
0.47GB file 2.49GB
Q3_0
0.66GB file 2.68GB
Q4_0
0.84GB file 2.86GB
Q5_0
1.03GB file 3.05GB
Q6_0
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

deepseek-r1-distill-qwen-14b

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

deepseek-r1-distill-qwen-32b

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q8_0
34GB file 36.52GB

deepseek-r1-distill-qwen-7b

7B 8K ctx
Q2_0
2.19GB file 4.3GB
Q3_0
3.06GB file 5.17GB
Q4_0
3.94GB file 6.05GB
Q5_0
4.81GB file 6.92GB
Q6_0
5.69GB file 7.8GB
Q8_0
7.44GB file 9.55GB

falcon3

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

gemma

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

gemma2

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

gemma3

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

granite-3.2-it

3.2B 8K ctx
Q2_0
1GB file 3.05GB
Q3_0
1.4GB file 3.45GB
Q4_0
1.8GB file 3.85GB
Q5_0
2.2GB file 4.25GB
Q6_0
2.6GB file 4.65GB
Q8_0
3.4GB file 5.45GB

hermes3

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

intellect-1

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

intellect-2

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

internlm3-8b-it

8B 8K ctx
Q2_0
2.5GB file 4.63GB
Q3_0
3.5GB file 5.63GB
Q4_0
4.5GB file 6.63GB
Q5_0
5.5GB file 7.63GB
Q6_0
6.5GB file 8.63GB
Q8_0
8.5GB file 10.63GB

llama3

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

llama3.1

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

llama3.2

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

llama3.3

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

llava-v1.6

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

marco-o1

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

mistral

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

mistral-nemo

12B 8K ctx
Q2_0
3.75GB file 5.95GB
Q3_0
5.25GB file 7.45GB
Q4_0
6.75GB file 8.95GB
Q5_0
8.25GB file 10.45GB
Q6_0
9.75GB file 11.95GB
Q8_0
12.75GB file 14.95GB

mistral-small-24b

24B 8K ctx
Q2_0
7.5GB file 9.89GB
Q3_0
10.5GB file 12.89GB
Q4_0
13.5GB file 15.89GB
Q5_0
16.5GB file 18.89GB
Q6_0
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

olmo-2

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

opencoder

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

openhermes-2.5

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

phi-3.5

3.8B 8K ctx
Q2_0
1.19GB file 3.25GB
Q3_0
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q5_0
2.61GB file 4.67GB
Q6_0
3.09GB file 5.15GB
Q8_0
4.04GB file 6.1GB

phi-4

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

phi-4-reasoning

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

qwen-qwq

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

qwen2

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

qwen2.5

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

qwen2.5-coder

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

qwen3

32B 8K ctx
Q2_0
10GB file 12.52GB
Q3_0
14GB file 16.52GB
Q4_0
18GB file 20.52GB
Q5_0
22GB file 24.52GB
Q6_0
26GB file 28.52GB
Q8_0
34GB file 36.52GB

qwq

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

sailor-2

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

simplescaling-s1

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

sky-t1

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

small-thinker

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

smollm2

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

tinyllama

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

tulu3

Unknown 8K ctx
Q2_0
0GB file 2GB
Q3_0
0GB file 2GB
Q4_0
0GB file 2GB
Q5_0
0GB file 2GB
Q6_0
0GB file 2GB
Q8_0
0GB file 2GB

yi-1.5

34B 8K ctx
Q2_0
10.63GB file 13.19GB
Q3_0
14.88GB file 17.44GB
Q4_0
19.13GB file 21.69GB
Q5_0
23.38GB file 25.94GB
Q6_0
27.63GB file 30.19GB
Q8_0
36.13GB file 38.69GB
C

Coru Nethron

9 models

aquif-3.5-Max-42B-A3B-Q4_K_M-GGUF

42B 8K ctx
Q4_0
23.63GB file 26.32GB
FP16
84GB file 86.69GB

aquif-3.5-Max-42B-A3B-Q5_K_M-GGUF

42B 8K ctx
Q5_0
28.88GB file 31.57GB
FP16
84GB file 86.69GB

aquif-3.5-Max-42B-A3B-Q6_K-GGUF

42B 8K ctx
Q6_0
34.13GB file 36.82GB
FP16
84GB file 86.69GB

aquif-moe-800M-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

iFlow-ROME-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

iFlow-ROME-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB

iFlow-ROME-Q6_K-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q6_0
0GB file 2GB

iFlow-ROME-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

JoyAI-LLM-Flash-Q5_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q5_0
0GB file 2GB
C

Cosmeq

1 models

Phi-4-mini-instruct-Q3_K_M-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB
C

Cosmosai471

2 models

Luna-v3

Unknown 8K ctx
FP16
0GB file 2GB

Luna-v4

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB
C

Courbeau

1 models

qwen-1.5b-rtu

1.5B 8K ctx
FP16
3GB file 5.02GB
C

Covaga

1 models

eplan-assistant-v2-gguf

3B 8K ctx
Q4_0
1.69GB file 3.74GB
FP16
6GB file 8.05GB
C

Covvenheimer

1 models

taylor_swift_model

Unknown 8K ctx
Q4_K_M
0GB file 2GB
C

Cow Why So

1 models

qwen3_5_2B_voice_assistant-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q5_K_M
1.38GB file 3.41GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB
C

Cowbone

2 models

ktdsbaseLM-v0.13-onbased-llama3.1-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB

llama3.1_korean_v1.1_sft_by_aidx-Q4_K_M-GGUF

Unknown 8K ctx
FP16
0GB file 2GB
Q4_0
0GB file 2GB
C

Cowoho

1 models

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB