All Supported Models

29681 AI models · 198875 quantization formats tracked

Q

Qwqw312

1 models

Qwaude4.5Opus

9B 8K ctx
Q2_K
2.81GB file 4.96GB
Q3_K_L
3.94GB file 6.09GB
Q3_K_M
3.94GB file 6.09GB
Q3_K_S
3.94GB file 6.09GB
Q4_K_M
5.06GB file 7.21GB
Q4_K_S
5.06GB file 7.21GB
Q5_K_M
6.19GB file 8.34GB
Q5_K_S
6.19GB file 8.34GB
Q6_K
7.31GB file 9.46GB
Q8_0
9.56GB file 11.71GB
BF16
18GB file 20.15GB
R

R A F A B T X

1 models

gemma-4-E2B-abliterated-btx-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
Q8_0
2.13GB file 4.16GB
BF16
4GB file 6.03GB
R

R Corvalan

26 models

Llama-3.1-Tulu-3-8B-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

OLMo-2-1124-13B-Instruct-Q3_K_M-GGUF

13B 8K ctx
Q3_0
5.69GB file 7.9GB
FP16
26GB file 28.21GB

OLMo-2-1124-13B-Instruct-Q4_0-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB

OLMo-2-1124-13B-Instruct-Q4_K_M-GGUF

13B 8K ctx
Q4_0
7.31GB file 9.52GB
FP16
26GB file 28.21GB

OLMo-2-1124-7B-Instruct-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

OLMo-2-1124-7B-Instruct-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

Phi-3-mini-128k-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3-mini-128k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-3.5-mini-instruct-Q4_K_M-GGUF

3.8B 8K ctx
Q4_0
2.14GB file 4.2GB
FP16
7.6GB file 9.66GB

Phi-3.5-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

Phi-4-mini-instruct-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Phi-4-mini-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

phi-4-Q2_K-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
FP16
28GB file 30.23GB

phi-4-Q3_K_L-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

phi-4-Q3_K_S-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

phi-4-Q4_0-GGUF

0B 8K ctx
Q4_0
0GB file 2GB

Qwen2.5-14B-Instruct-1M-Q3_K_M-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

Qwen2.5-14B-Instruct-1M-Q3_K_S-GGUF

14B 8K ctx
Q3_0
6.13GB file 8.36GB
FP16
28GB file 30.23GB

Qwen2.5-14B-Instruct-1M-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen2.5-7B-Instruct-1M-Q4_K_M-GGUF

7B 8K ctx
Q4_0
3.94GB file 6.05GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-1M-Q6_K-GGUF

7B 8K ctx
Q6_0
5.69GB file 7.8GB
FP16
14GB file 16.11GB

Qwen2.5-7B-Instruct-1M-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

QwQ-32B-Q2_K-GGUF

32B 8K ctx
Q2_0
10GB file 12.52GB
FP16
64GB file 66.52GB

QwQ-32B-Q4_K_M-GGUF

32B 8K ctx
Q4_0
18GB file 20.52GB
FP16
64GB file 66.52GB

QwQ-32B-Q8_0-GGUF

32B 8K ctx
Q8_0
34GB file 36.52GB
R

R Dson

7 models

CoderO1-DeepSeekR1-14B-Preview-GGUF

14B 8K ctx
Q2_0
4.38GB file 6.61GB
Q3_0
6.13GB file 8.36GB
Q4_0
7.88GB file 10.11GB
Q5_0
9.63GB file 11.86GB
Q6_0
11.38GB file 13.61GB
Q8_0
14.88GB file 17.11GB

Orca-Llama-3-8B-Instruct-DPO-GGUF

8B 8K ctx
Q4_K_M
4.5GB file 6.63GB
Q8_0
8.5GB file 10.63GB

Phi-3-medium-128k-instruct-GGUF

3.8B 8K ctx
Q2_K
1.19GB file 3.25GB
Q3_K
1.66GB file 3.72GB
Q3_K_L
1.66GB file 3.72GB
Q3_K_M
1.66GB file 3.72GB
Q3_K_S
1.66GB file 3.72GB
Q4_0
2.14GB file 4.2GB
Q4_1
2.14GB file 4.2GB
Q4_K
2.14GB file 4.2GB
Q4_K_M
2.14GB file 4.2GB
Q4_K_S
2.14GB file 4.2GB

Qwen3.6-27B-IQ4_KS-GGUF

27B 8K ctx
Q4_K
15.19GB file 17.63GB

Qwen3.6-27B-MTP-IQ4_KS-GGUF

27B 8K ctx
Q4_K
15.19GB file 17.63GB

Seed-OSS-36B-Instruct-GGUF

36B 8K ctx
Q2_K
11.25GB file 13.84GB
Q2_XXS
11.25GB file 13.84GB
Q3_K_L
15.75GB file 18.34GB
Q3_K_M
15.75GB file 18.34GB
Q3_K_S
15.75GB file 18.34GB
Q4_0
20.25GB file 22.84GB
Q4_K_M
20.25GB file 22.84GB
Q4_K_S
20.25GB file 22.84GB
Q4_XS
20.25GB file 22.84GB
Q5_K_M
24.75GB file 27.34GB
Q5_K_S
24.75GB file 27.34GB
Q6_K
29.25GB file 31.84GB
Q1_M
36GB file 38.59GB
Q8_0
38.25GB file 40.84GB

WomboCombo-R1-Coder-14B-Preview

14B 8K ctx
Q8_0
14.88GB file 17.11GB
R

R E X A I A N A L Y S E

1 models

Phi-4-mini-instruct-GGUF

14B 8K ctx
Q8_0
14.88GB file 17.11GB
R

R E X A I C O D E R

2 models

Qwen2.5.1-Coder-7B-Instruct-GGUF

7B 8K ctx
Q5_K_M
4.81GB file 6.92GB

REX

1.5B 8K ctx
Q5_0
1.03GB file 3.05GB
FP16
3GB file 5.02GB
R

R E X A I W R I T E

1 models

gemma-2-9b-it-GGUF

9B 8K ctx
Q4_K_M
5.06GB file 7.21GB
R

R J1200

3 models

llama-3_1b-fine_tuned

1B 8K ctx
FP16
2GB file 4.02GB

llama-3_3b-fine_tuned

3B 8K ctx
FP16
6GB file 8.05GB

llama-3-fine_tuned_C

8B 8K ctx
FP16
16GB file 18.13GB
R

R Muniramaiah

1 models

llama-2-7b-chat-doctor

7B 8K ctx
Q4_K_M
3.94GB file 6.05GB
R

R N O H M R K G

1 models

Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB
FP16
16GB file 18.13GB