All Supported Models

29681 AI models · 198875 quantization formats tracked

R

Rcorvohan

2 models

Qwen3.5-122B-A10B-Opus-Reasoning-GGUF

122B 8K ctx
Q2_K
38.13GB file 42.13GB
Q3_K_M
53.38GB file 57.38GB
Q4_K_M
68.63GB file 72.63GB
Q5_K_M
83.88GB file 87.88GB
Q6_K
99.13GB file 103.13GB
Q8_0
129.63GB file 133.63GB
BF16
244GB file 248GB

Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic-v2-GGUF

27B 8K ctx
Q4_K_M
15.19GB file 17.63GB
Q4_K_S
15.19GB file 17.63GB
Q5_K_M
18.56GB file 21GB
Q5_K_S
18.56GB file 21GB
Q6_K
21.94GB file 24.38GB
Q8_0
28.69GB file 31.13GB
BF16
54GB file 56.44GB
R

Rdk94

1 models

Llama-3-Ko-8B-Instruct-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB
R

Rdouglas

1 models

llama-2-7b-chat-guanaco-test

7B 8K ctx
FP16
14GB file 16.11GB
R

Rdrgzlng

1 models

gemma-4-E2B-it-GGUF

2B 8K ctx
Q4_K_M
1.13GB file 3.16GB
FP16
4GB file 6.03GB
R

Rdsm

2 models

QwenPhi-4-0.5b-Draft-GGUF

0.5B 8K ctx
Q4_0
0.28GB file 2.29GB
Q8_0
0.53GB file 2.54GB
FP16
1GB file 3.01GB

QwenUnslothPhi-4-0.5b-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
R

Rdubwiley

2 models

SmolLM3-3B-distilled-py

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB

SmolLM3-3B-distilled-py-tools

3B 8K ctx
Q4_K_M
1.69GB file 3.74GB
R

Rdziubek

1 models

Llama-3.2-1B-Instruct-Q8_0-GGUF

1B 8K ctx
Q8_0
1.06GB file 3.08GB
R

Re Xee D

2 models

Luminus-1.5B-Roleplay-GGUF

1.5B 8K ctx
Q3_K_M
0.66GB file 2.68GB
Q4_K_M
0.84GB file 2.86GB
Q5_K_M
1.03GB file 3.05GB
Q6_K
1.22GB file 3.24GB
Q8_0
1.59GB file 3.61GB

TASX-Cmd-0.5B-GGUF

0.5B 8K ctx
Q8_0
0.53GB file 2.54GB
R

Reach Vb

11 models

CodeQwen1.5-7B-Chat-Q3_K_S-GGUF

7B 8K ctx
Q3_0
3.06GB file 5.17GB
FP16
14GB file 16.11GB

l3.2-1b-test

1B 8K ctx
Q4_0
0.56GB file 2.58GB
FP16
2GB file 4.02GB

Meta-Llama-3-8B-Q4_0-GGUF

8B 8K ctx
Q4_0
4.5GB file 6.63GB

Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

8B 8K ctx
Q6_0
6.5GB file 8.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q2_K-GGUF

8B 8K ctx
Q2_0
2.5GB file 4.63GB
FP16
16GB file 18.13GB

Meta-Llama-3.1-8B-Q8_0-GGUF

8B 8K ctx
Q8_0
8.5GB file 10.63GB

NuminaMath-7B-TIR-Q8_0-GGUF

7B 8K ctx
Q8_0
7.44GB file 9.55GB

phi-2-Q2_K-GGUF

Unknown 8K ctx
Q2_K
0GB file 2GB

Phi-3-mini-4k-instruct-Q8_0-GGUF

0B 8K ctx
Q8_0
0GB file 2GB

phi-4-Q4_K_M-GGUF

14B 8K ctx
Q4_0
7.88GB file 10.11GB
FP16
28GB file 30.23GB

Qwen3-0.6B-Q8_0-GGUF

0.6B 8K ctx
Q8_0
0.64GB file 2.65GB
R

Ready Art

5 models

Broken-Tutu-24B-Transgression-v2.0-GGUF

24B 8K ctx
Q4_K_M
13.5GB file 15.89GB
Q6_K
19.5GB file 21.89GB
Q8_0
25.5GB file 27.89GB

Broken-Tutu-24B-Unslop-v2.0-GGUF

24B 8K ctx
Q8_0
25.5GB file 27.89GB

MS3.2-The-Omega-Directive-24B-Unslop-v2.1-GGUF

24B 8K ctx
Q8_0
25.5GB file 27.89GB

Omega-Darker_The-Final-Directive-24B-GGUF

24B 8K ctx
Q8_0
25.5GB file 27.89GB

Omega-Darker-Gaslight_The-Final-Forgotten-Fever-Dream-24B-GGUF

24B 8K ctx
Q8_0
25.5GB file 27.89GB